[ 528.869855] env[65268]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 528.869855] env[65268]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 529.877692] env[65359]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 529.877692] env[65359]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 531.448541] env[65359]: INFO neutron.common.config [-] Logging enabled! [ 531.448880] env[65359]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 27.0.1.dev60 [ 531.449114] env[65359]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65359) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 531.449422] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 531.449520] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 531.450359] env[65359]: WARNING oslo_policy.policy [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 531.450580] env[65359]: WARNING oslo_policy.policy [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 531.452294] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] VMware NSXv3 Agent initialized successfully. [ 531.452642] env[65359]: DEBUG oslo_concurrency.lockutils [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] Acquiring lock "singleton_lock" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 531.452770] env[65359]: DEBUG oslo_concurrency.lockutils [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] Acquired lock "singleton_lock" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 531.452976] env[65359]: DEBUG oslo_concurrency.lockutils [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] Releasing lock "singleton_lock" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 531.453284] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] Full set of CONF: {{(pid=65359) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:274}} [ 531.453395] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ******************************************************************************** {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 531.453497] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] Configuration options gathered from: {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 531.453849] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 531.454024] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 531.454130] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ================================================================================ {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 531.454293] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] agent_down_time = 75 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.454429] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] allow_automatic_dhcp_failover = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.454562] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] allow_bulk = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.454702] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] api_extensions_path = {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.454839] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] api_paste_config = api-paste.ini {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.454972] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] auth_strategy = keystone {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.455086] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] backdoor_port = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.455183] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] backdoor_socket = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.455314] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] backlog = 4096 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.455449] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] base_mac = fa:16:3e:00:00:00 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.455605] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] bind_host = 0.0.0.0 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.455742] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] bind_port = 9696 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.455873] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] client_socket_timeout = 900 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.456015] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] config_dir = [] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.456126] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.456259] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] config_source = [] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.456433] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] control_exchange = neutron {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.456571] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] core_plugin = ml2 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.456706] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] debug = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.456835] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] default_availability_zones = [] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.457045] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.457184] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] dhcp_agent_notification = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.457314] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] dhcp_agents_per_network = 1 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.457446] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] dhcp_lease_duration = 86400 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.457589] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] dhcp_load_type = networks {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.457725] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] dns_domain = openstacklocal {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.457859] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.457990] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] enable_default_route_bfd = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.458129] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] enable_default_route_ecmp = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.458258] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] enable_dvr = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.458385] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] enable_new_agents = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.458537] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.458671] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] enable_signals = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.458800] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] enable_traditional_dhcp = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.458925] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] external_dns_driver = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.459066] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] filter_validation = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.459211] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] global_physnet_mtu = 8950 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.459341] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] graceful_shutdown_timeout = 60 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.459518] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] host = cpu-1 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.459657] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] host_dvr_for_dhcp = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.459787] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] http_retries = 3 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.459921] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] instance_format = [instance: %(uuid)s] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.460064] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.460199] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ipam_driver = internal {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.460326] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ipv6_pd_enabled = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.460452] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] l3_ha = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.460586] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.460725] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] l3_ha_network_physical_name = {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.460875] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] l3_ha_network_type = {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.461021] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] log_color = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.461158] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] log_config_append = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.461290] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.461416] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] log_dir = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.461543] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] log_file = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.461643] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] log_options = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.461775] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] log_rotate_interval = 1 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.461912] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] log_rotate_interval_type = days {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.462060] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] log_rotation_type = none {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.462164] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.462263] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.462399] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.462532] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.462630] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.462758] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] max_dns_nameservers = 5 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.462886] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] max_header_line = 16384 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.463021] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] max_l3_agents_per_router = 3 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.463147] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] max_logfile_count = 30 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.463271] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] max_logfile_size_mb = 200 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.463396] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] max_subnet_host_routes = 20 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.463532] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] my_ip = 10.180.1.21 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.463663] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] my_ipv6 = ::1 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.463877] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] network_auto_schedule = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.464017] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] network_link_prefix = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.464153] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.464288] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] notify_nova_on_port_data_changes = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.464423] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] notify_nova_on_port_status_changes = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.464561] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] pagination_max_limit = -1 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.464690] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] publish_errors = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.464819] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] rate_limit_burst = 0 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.464955] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] rate_limit_except_level = CRITICAL {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.465095] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] rate_limit_interval = 0 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.465225] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] retry_until_window = 30 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.465353] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] router_distributed = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.465480] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] rpc_resources_processing_step = 20 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.465608] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] rpc_response_max_timeout = 600 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.465736] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] rpc_response_timeout = 60 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.465858] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] send_events_interval = 2 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.466009] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] service_plugins = ['router'] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.466149] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] setproctitle = on {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.466275] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] shell_completion = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.466455] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] state_path = /opt/stack/data/neutron {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.466596] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] syslog_log_facility = LOG_USER {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.466730] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] tcp_keepidle = 600 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.466867] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] transport_url = **** {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.466997] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] use_journal = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.467142] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] use_json = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.467296] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] use_ssl = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.467398] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] use_stderr = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.467526] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] use_syslog = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.467652] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] vlan_qinq = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.467774] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] vlan_transparent = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.467901] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] watch_log_file = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.468038] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] wsgi_default_pool_size = 100 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.468166] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] wsgi_keep_alive = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.468301] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.468450] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] wsgi_server_debug = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 531.468614] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_concurrency.disable_process_locking = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.468753] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.468894] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.469037] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.469182] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.469321] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.469456] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.469604] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] profiler.connection_string = messaging:// {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.469741] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] profiler.enabled = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.469882] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] profiler.es_doc_type = notification {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.470028] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] profiler.es_scroll_size = 10000 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.470175] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] profiler.es_scroll_time = 2m {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.470308] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] profiler.filter_error_trace = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.470446] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] profiler.hmac_keys = **** {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.470586] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] profiler.sentinel_service_name = mymaster {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.470742] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] profiler.socket_timeout = 0.1 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.470889] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] profiler.trace_requests = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.471035] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] profiler.trace_sqlalchemy = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.471188] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] profiler_jaeger.process_tags = {} {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.471320] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] profiler_jaeger.service_name_prefix = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.471455] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] profiler_otlp.service_name_prefix = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.471607] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_policy.enforce_new_defaults = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.471884] env[65359]: WARNING oslo_config.cfg [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 531.472043] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_policy.enforce_scope = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.472189] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_policy.policy_default_rule = default {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.472340] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.472483] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.472627] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.472759] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.472890] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.473026] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.473164] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.473304] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_policy.remote_timeout = 60.0 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.473448] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.473592] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] agent.extensions = [] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.473733] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.473872] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] service_providers.service_provider = [] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.474055] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] QUOTAS.default_quota = -1 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.474206] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.474342] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] QUOTAS.quota_floatingip = 50 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.474475] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] QUOTAS.quota_network = 100 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.474606] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] QUOTAS.quota_port = 500 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.474737] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.474863] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] QUOTAS.quota_router = 10 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.474991] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] QUOTAS.quota_security_group = 10 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.475133] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.475259] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] QUOTAS.quota_subnet = 100 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.475388] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] QUOTAS.track_quota_usage = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.475533] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.475665] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep.group = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.475792] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep.helper_command = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.475954] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep.log_daemon_traceback = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.476201] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.476432] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep.thread_pool_size = 8 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.476652] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep.user = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.476885] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.477094] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_dhcp_release.group = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.477242] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_dhcp_release.helper_command = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.477379] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.477517] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.477653] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.477781] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_dhcp_release.user = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.477918] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.478056] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_ovs_vsctl.group = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.478187] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_ovs_vsctl.helper_command = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.478315] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.478476] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.478624] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.478758] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_ovs_vsctl.user = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.478896] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_namespace.capabilities = [21] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.479036] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_namespace.group = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.479169] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_namespace.helper_command = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.479301] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_namespace.log_daemon_traceback = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.479454] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.479598] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_namespace.thread_pool_size = 8 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.479727] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_namespace.user = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.479863] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_conntrack.capabilities = [12] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.479991] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_conntrack.group = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.480132] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_conntrack.helper_command = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.480261] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.480396] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.480529] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.480655] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_conntrack.user = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.480802] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_link.capabilities = [12, 21] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.480930] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_link.group = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.481065] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_link.helper_command = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.481199] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_link.log_daemon_traceback = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.481332] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.481462] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_link.thread_pool_size = 8 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.481587] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] privsep_link.user = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.481735] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.481882] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.482037] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.continue_on_failed_promotions = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.482179] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.dscp = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.482314] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.dscp_inherit = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.482455] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.force_mp_to_policy = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.482587] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.locking_coordinator_url = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.482718] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.log_agent_heartbeats = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.482848] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.logging_expire = 1 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.482987] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.483131] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.483270] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.polling_interval = 240 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.483401] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.483544] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.483686] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.report_interval = 30.0 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.483827] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.483969] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.484123] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.484261] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.sync_skew = 60 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.484397] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.synchronization_queue_size = 20 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.484532] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT.use_helper_for_ns_read = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.484673] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] SECURITYGROUP.enable_ipset = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.484814] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] SECURITYGROUP.enable_security_group = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.484953] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.485105] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.485245] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] experimental.ipv6_pd_enabled = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.485400] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ml2.extension_drivers = ['port_security'] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.485538] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ml2.external_network_type = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.485686] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.485829] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ml2.overlay_ip_version = 4 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.485969] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ml2.path_mtu = 8950 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.486130] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ml2.physical_network_mtus = {} {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.486276] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ml2.tenant_network_types = ['vlan'] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.486425] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.486566] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ml2.type_drivers = ['vlan'] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.486993] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT_CLI.neutron_port_id = [] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.487183] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.487328] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.487481] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.487630] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.487769] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.487910] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.488064] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.488207] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.488420] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.488627] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_login_password = **** {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.488795] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_login_port = 443 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.488942] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_login_user = admin {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.489096] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.489243] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.489379] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.489547] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.489700] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.489844] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.489987] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.490138] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.490278] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.490425] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.490558] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.490700] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.490839] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.491040] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.491191] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] vsphere.vsphere_login_password = VMware1! {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.491330] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.491462] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.491605] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] nova.auth_section = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.491745] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] nova.auth_type = password {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.491885] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.492027] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] nova.certfile = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.492163] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] nova.collect_timing = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.492309] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] nova.endpoint_type = public {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.492441] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] nova.insecure = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.492575] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] nova.keyfile = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.492714] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] nova.region_name = RegionOne {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.492843] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] nova.split_loggers = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.492974] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] nova.timeout = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.493119] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] placement.auth_section = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.493265] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] placement.auth_type = password {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.493401] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.493529] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] placement.certfile = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.493663] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] placement.collect_timing = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.493797] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] placement.endpoint_type = public {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.493925] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] placement.insecure = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.494061] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] placement.keyfile = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.494183] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] placement.region_name = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.494313] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] placement.split_loggers = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.494434] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] placement.timeout = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.494569] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.auth_section = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.494707] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.auth_type = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.494838] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.cafile = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.494964] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.certfile = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.495108] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.collect_timing = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.495235] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.connect_retries = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.495363] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.connect_retry_delay = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.495493] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.enable_notifications = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.495628] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.endpoint_override = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.495753] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.insecure = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.495883] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.interface = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.496013] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.keyfile = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.496151] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.max_version = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.496275] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.min_version = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.496399] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.region_name = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.496524] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.retriable_status_codes = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.496646] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.service_name = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.496769] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.service_type = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.496899] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.split_loggers = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.497037] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.status_code_retries = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.497168] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.status_code_retry_delay = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.497296] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.timeout = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.497426] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.valid_interfaces = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.497559] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ironic.version = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.497696] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] cli_script.dry_run = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.497839] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.497972] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.498115] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.498246] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.498375] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.498535] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.498673] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.498828] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.498962] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.499120] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.499253] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.499393] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.499560] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.499699] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.499830] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.499967] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.500111] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.500245] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.500379] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.500508] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.500638] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.500766] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.500891] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.501032] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.501165] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.501294] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.501428] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.501562] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.501695] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.501859] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.501997] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.ssl = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.502153] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.502294] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.502430] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.502570] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.502707] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.ssl_version = {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.502841] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.502986] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_notifications.driver = [] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.503134] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_notifications.retry = -1 {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.503283] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.503416] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] oslo_messaging_notifications.transport_url = **** {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 531.503521] env[65359]: DEBUG oslo_service.backend._eventlet.service [None req-a9243f5c-c5f8-4ba2-b443-d099a0b9711a None None] ******************************************************************************** {{(pid=65359) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 531.504681] env[65359]: DEBUG neutron.agent.securitygroups_rpc [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Init firewall settings (driver=nsxv3) {{(pid=65359) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 531.506026] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65359) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 531.506272] env[65359]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] RPC agent_id: nsxm-l-01a.corp.local [ 531.508580] env[65359]: DEBUG dogpile.cache.region [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 531.508697] env[65359]: DEBUG dogpile.lock [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 531.508798] env[65359]: DEBUG dogpile.lock [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 531.508885] env[65359]: DEBUG dogpile.lock [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 531.508978] env[65359]: DEBUG dogpile.cache.region [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 531.509075] env[65359]: DEBUG dogpile.lock [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 531.509201] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 531.564105] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Session token - acquiring [ 531.566133] env[65359]: DEBUG networking_nsxv3.common.locking [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 531.566384] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 531.566564] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 531.567053] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 531.580032] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 531.879580] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 531.903098] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 531.903263] env[65359]: DEBUG dogpile.cache.region [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Cache value generated in 0.394 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 531.903419] env[65359]: DEBUG dogpile.lock [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 531.903482] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Activating Policy API Provider. [ 531.903662] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Looking for the default Infrastructure Rules. [ 531.970567] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Looking for the Default Layer3 Logged Drop Section. [ 531.986962] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 531.987455] env[65359]: DEBUG networking_nsxv3.common.locking [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 531.987632] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquiring lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 531.987732] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 531.988037] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired external semaphore "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 531.988377] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 532.503292] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 533.005849] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 533.507855] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Inventory metadata is going to be refreshed. [ 533.508256] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 534.305883] env[65359]: DEBUG networking_nsxv3.common.locking [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.306266] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.306266] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.306634] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.317488] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 534.319458] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.320086] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 534.342025] env[65359]: DEBUG networking_nsxv3.common.locking [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.342358] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.342358] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.342597] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.342717] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.342863] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 534.342973] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 534.343086] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 534.362909] env[65359]: DEBUG networking_nsxv3.common.locking [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.363248] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.363248] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.363464] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.363709] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.363862] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 534.383838] env[65359]: DEBUG networking_nsxv3.common.locking [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.384166] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.384166] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.384385] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.384523] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.384827] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 534.410476] env[65359]: DEBUG networking_nsxv3.common.locking [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.410781] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquiring lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.410781] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.411061] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired external semaphore "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.411174] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Releasing lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.411335] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 534.411447] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 534.411548] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 534.430981] env[65359]: DEBUG networking_nsxv3.common.locking [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.431261] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquiring lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.431344] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.431569] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired external semaphore "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.431692] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Releasing lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.431830] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 534.431928] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 534.432038] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 534.454589] env[65359]: DEBUG networking_nsxv3.common.locking [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.454873] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.454873] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.455145] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.455285] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.455434] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 534.455555] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 534.455757] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Inventory metadata have been refreshed. [ 534.455857] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Dryrun:True. Metadata refresh completed. [ 534.455976] env[65359]: DEBUG oslo_concurrency.lockutils [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Releasing lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.457630] env[65359]: INFO neutron.agent.agent_extensions_manager [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Loaded agent extensions: [] [ 534.458345] env[65359]: DEBUG neutron_lib.callbacks.manager [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65359) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 534.508537] env[65359]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] NSXv3 Agent Agent RPC Daemon Started! [ 534.508887] env[65359]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] NSXv3 Agent Agent loop - iteration:0 started [ 534.508887] env[65359]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] NSXv3 Agent Agent out of sync with plugin! [ 539.459245] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 539.459679] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 544.460789] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 544.461168] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 547.296503] env[65359]: INFO networking_nsxv3.common.synchronization [None req-cbefc1e2-2e22-467a-a110-e6c4d7285ceb demo admin] Enqueued Resource ID: 0896c4ed-0792-4e01-95cd-2a2c94db6bcd with Priority: HIGHEST for action security_group_rules [ 547.297122] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0896c4ed-0792-4e01-95cd-2a2c94db6bcd with Priority: HIGHEST for action security_group_rules [ 547.297429] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0896c4ed-0792-4e01-95cd-2a2c94db6bcd taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.297563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0896c4ed-0792-4e01-95cd-2a2c94db6bcd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.297631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0896c4ed-0792-4e01-95cd-2a2c94db6bcd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.297963] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0896c4ed-0792-4e01-95cd-2a2c94db6bcd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.298089] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0896c4ed-0792-4e01-95cd-2a2c94db6bcd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.822317] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.822564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.822564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.822774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.822847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.822941] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0896c4ed-0792-4e01-95cd-2a2c94db6bcd already deleted. [ 547.823270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0896c4ed-0792-4e01-95cd-2a2c94db6bcd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.299073] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 552.299073] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 557.300389] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 557.300389] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.301675] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 562.302178] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 567.302929] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 567.303373] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 572.304542] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 572.304542] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 573.314712] env[65359]: INFO networking_nsxv3.common.synchronization [None req-29624a69-c726-4c7f-b39c-b63e0ec1ef33 None None] Enqueued Resource ID: bdd4e5a5-3c25-4f45-a0a6-c8415522f8b3 with Priority: HIGHEST for action port [ 573.314988] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd4e5a5-3c25-4f45-a0a6-c8415522f8b3 with Priority: HIGHEST for action port [ 573.316088] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdd4e5a5-3c25-4f45-a0a6-c8415522f8b3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.316088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdd4e5a5-3c25-4f45-a0a6-c8415522f8b3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.316088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdd4e5a5-3c25-4f45-a0a6-c8415522f8b3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.316088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdd4e5a5-3c25-4f45-a0a6-c8415522f8b3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.316088] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdd4e5a5-3c25-4f45-a0a6-c8415522f8b3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.818814] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bdd4e5a5-3c25-4f45-a0a6-c8415522f8b3 [ 573.819069] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.819236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.819308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.819519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.819608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.819698] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bdd4e5a5-3c25-4f45-a0a6-c8415522f8b3 already deleted. [ 573.819779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdd4e5a5-3c25-4f45-a0a6-c8415522f8b3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.200592] env[65359]: INFO networking_nsxv3.common.synchronization [None req-0f0d92ee-a5bf-4cba-be66-f356dca79f23 None None] Enqueued Resource ID: fd39832d-bd23-43e3-b34f-ab96d621e12c with Priority: HIGHEST for action port [ 575.206128] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd39832d-bd23-43e3-b34f-ab96d621e12c with Priority: HIGHEST for action port [ 575.206966] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd39832d-bd23-43e3-b34f-ab96d621e12c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.206966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd39832d-bd23-43e3-b34f-ab96d621e12c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.206966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd39832d-bd23-43e3-b34f-ab96d621e12c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.207410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd39832d-bd23-43e3-b34f-ab96d621e12c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.207410] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd39832d-bd23-43e3-b34f-ab96d621e12c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.709648] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd39832d-bd23-43e3-b34f-ab96d621e12c [ 575.709885] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.710035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.710112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.710371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.710466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.710583] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd39832d-bd23-43e3-b34f-ab96d621e12c already deleted. [ 575.710681] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd39832d-bd23-43e3-b34f-ab96d621e12c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.036044] env[65359]: INFO networking_nsxv3.common.synchronization [None req-0f5d8ad6-9d8e-49f4-8fd7-a7f67a5d57c6 None None] Enqueued Resource ID: 66f8ffc2-8ed8-42f0-bd0a-1b0ac739b564 with Priority: HIGHEST for action port [ 576.036044] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f8ffc2-8ed8-42f0-bd0a-1b0ac739b564 with Priority: HIGHEST for action port [ 576.036044] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-66f8ffc2-8ed8-42f0-bd0a-1b0ac739b564 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.036044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66f8ffc2-8ed8-42f0-bd0a-1b0ac739b564" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.036380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66f8ffc2-8ed8-42f0-bd0a-1b0ac739b564" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.036778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66f8ffc2-8ed8-42f0-bd0a-1b0ac739b564" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.037061] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66f8ffc2-8ed8-42f0-bd0a-1b0ac739b564',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.539609] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66f8ffc2-8ed8-42f0-bd0a-1b0ac739b564 [ 576.539893] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.539960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.540238] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.540352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.540404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.540459] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66f8ffc2-8ed8-42f0-bd0a-1b0ac739b564 already deleted. [ 576.540544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66f8ffc2-8ed8-42f0-bd0a-1b0ac739b564" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.582610] env[65359]: INFO networking_nsxv3.common.synchronization [None req-651a0dec-24d7-4d4f-9f21-6b0a8a01bd67 None None] Enqueued Resource ID: 2185eb64-9206-4d8e-93c0-e15da46bc394 with Priority: HIGHEST for action port [ 577.583549] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2185eb64-9206-4d8e-93c0-e15da46bc394 with Priority: HIGHEST for action port [ 577.583783] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-2185eb64-9206-4d8e-93c0-e15da46bc394 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.584012] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2185eb64-9206-4d8e-93c0-e15da46bc394" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.584081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2185eb64-9206-4d8e-93c0-e15da46bc394" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.584325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2185eb64-9206-4d8e-93c0-e15da46bc394" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.584380] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2185eb64-9206-4d8e-93c0-e15da46bc394',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.024423] env[65359]: INFO networking_nsxv3.common.synchronization [None req-17ea30d1-eedd-4963-9780-b9d8f21cdcc9 None None] Enqueued Resource ID: 5ecfdccb-e968-4a53-be93-f55f102b83f6 with Priority: HIGHEST for action port [ 578.024423] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ecfdccb-e968-4a53-be93-f55f102b83f6 with Priority: HIGHEST for action port [ 578.024774] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ecfdccb-e968-4a53-be93-f55f102b83f6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.024923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ecfdccb-e968-4a53-be93-f55f102b83f6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.025011] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ecfdccb-e968-4a53-be93-f55f102b83f6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.025282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ecfdccb-e968-4a53-be93-f55f102b83f6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.025365] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ecfdccb-e968-4a53-be93-f55f102b83f6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.086489] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2185eb64-9206-4d8e-93c0-e15da46bc394 [ 578.086798] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.087096] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.090543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.090797] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.090892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.090992] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2185eb64-9206-4d8e-93c0-e15da46bc394 already deleted. [ 578.091095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2185eb64-9206-4d8e-93c0-e15da46bc394" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.528110] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ecfdccb-e968-4a53-be93-f55f102b83f6 [ 578.529684] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.529684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.529684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.529684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.529684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.529684] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ecfdccb-e968-4a53-be93-f55f102b83f6 already deleted. [ 578.529684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ecfdccb-e968-4a53-be93-f55f102b83f6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.345782] env[65359]: INFO networking_nsxv3.common.synchronization [None req-37639f12-3a04-4fdb-bf4e-012f63eb2b1d None None] Enqueued Resource ID: 19bb40d5-3a35-4bc2-8a76-04d441988deb with Priority: HIGHEST for action port [ 579.347455] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19bb40d5-3a35-4bc2-8a76-04d441988deb with Priority: HIGHEST for action port [ 579.347897] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-19bb40d5-3a35-4bc2-8a76-04d441988deb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.348158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19bb40d5-3a35-4bc2-8a76-04d441988deb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.348355] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19bb40d5-3a35-4bc2-8a76-04d441988deb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.348874] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19bb40d5-3a35-4bc2-8a76-04d441988deb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.349061] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19bb40d5-3a35-4bc2-8a76-04d441988deb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.852903] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19bb40d5-3a35-4bc2-8a76-04d441988deb [ 579.853375] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.853528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.853634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.853816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.853910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.854018] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19bb40d5-3a35-4bc2-8a76-04d441988deb already deleted. [ 579.854132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19bb40d5-3a35-4bc2-8a76-04d441988deb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.951841] env[65359]: INFO networking_nsxv3.common.synchronization [None req-eceb6e73-6e06-4092-8319-6760290a7ce0 None None] Enqueued Resource ID: f64708d2-2815-409d-9385-f4cd3abf7449 with Priority: HIGHEST for action port [ 579.952691] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f64708d2-2815-409d-9385-f4cd3abf7449 with Priority: HIGHEST for action port [ 579.952997] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-f64708d2-2815-409d-9385-f4cd3abf7449 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.953800] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f64708d2-2815-409d-9385-f4cd3abf7449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.953885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f64708d2-2815-409d-9385-f4cd3abf7449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.954394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f64708d2-2815-409d-9385-f4cd3abf7449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.954394] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f64708d2-2815-409d-9385-f4cd3abf7449',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.459387] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f64708d2-2815-409d-9385-f4cd3abf7449 [ 580.459387] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.459387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.459387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.459387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.459387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.459387] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f64708d2-2815-409d-9385-f4cd3abf7449 already deleted. [ 580.459387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f64708d2-2815-409d-9385-f4cd3abf7449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.831196] env[65359]: INFO networking_nsxv3.common.synchronization [None req-4d022fee-ceb7-4a63-ad33-a75e2823021c None None] Enqueued Resource ID: 6178d6c6-3d3e-494a-bb05-31eb8caa4e54 with Priority: HIGHEST for action port [ 580.831454] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6178d6c6-3d3e-494a-bb05-31eb8caa4e54 with Priority: HIGHEST for action port [ 580.832449] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-6178d6c6-3d3e-494a-bb05-31eb8caa4e54 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.832538] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6178d6c6-3d3e-494a-bb05-31eb8caa4e54" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.832636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6178d6c6-3d3e-494a-bb05-31eb8caa4e54" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.832846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6178d6c6-3d3e-494a-bb05-31eb8caa4e54" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.832925] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6178d6c6-3d3e-494a-bb05-31eb8caa4e54',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.337431] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6178d6c6-3d3e-494a-bb05-31eb8caa4e54 [ 581.337667] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.337992] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.337992] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.338115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.338228] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.338566] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6178d6c6-3d3e-494a-bb05-31eb8caa4e54 already deleted. [ 581.338566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6178d6c6-3d3e-494a-bb05-31eb8caa4e54" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.776483] env[65359]: INFO networking_nsxv3.common.synchronization [None req-f2fb0b86-0dec-4662-94db-a3670477a7e4 None None] Enqueued Resource ID: f4e269ed-2855-4659-a530-b4b25bf64103 with Priority: HIGHEST for action port [ 581.777758] env[65359]: INFO networking_nsxv3.common.synchronization [None req-07bd8114-0ccf-433d-8427-5c307f87f68c None None] Enqueued Resource ID: 77631db4-31d8-48b7-9a03-526676159b57 with Priority: HIGHEST for action port [ 581.778047] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e269ed-2855-4659-a530-b4b25bf64103 with Priority: HIGHEST for action port [ 581.778192] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77631db4-31d8-48b7-9a03-526676159b57 with Priority: HIGHEST for action port [ 581.778803] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4e269ed-2855-4659-a530-b4b25bf64103 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.779888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4e269ed-2855-4659-a530-b4b25bf64103" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.780111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4e269ed-2855-4659-a530-b4b25bf64103" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.781762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4e269ed-2855-4659-a530-b4b25bf64103" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.781762] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4e269ed-2855-4659-a530-b4b25bf64103',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.784711] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-77631db4-31d8-48b7-9a03-526676159b57 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.784826] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77631db4-31d8-48b7-9a03-526676159b57" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.784884] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77631db4-31d8-48b7-9a03-526676159b57" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.785121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77631db4-31d8-48b7-9a03-526676159b57" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.785205] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77631db4-31d8-48b7-9a03-526676159b57',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.286930] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4e269ed-2855-4659-a530-b4b25bf64103 [ 582.286930] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.286930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.286930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.287114] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.287114] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.288215] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4e269ed-2855-4659-a530-b4b25bf64103 already deleted. [ 582.288744] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4e269ed-2855-4659-a530-b4b25bf64103" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.288744] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77631db4-31d8-48b7-9a03-526676159b57 [ 582.288744] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.288906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.288906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.289036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.290674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.290674] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77631db4-31d8-48b7-9a03-526676159b57 already deleted. [ 582.290674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77631db4-31d8-48b7-9a03-526676159b57" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.433776] env[65359]: INFO networking_nsxv3.common.synchronization [req-c5cbe25b-b9cb-46fa-8805-bd8f9736d784 req-cf498333-4e43-4474-89f7-534792b16d61 tempest-SecurityGroupRulesNegativeTestJSON-816495707 tempest-SecurityGroupRulesNegativeTestJSON-816495707-project-member] Enqueued Resource ID: 68aca545-a440-43ea-9fd9-cee636cc06f4 with Priority: HIGHEST for action security_group_rules [ 582.433776] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68aca545-a440-43ea-9fd9-cee636cc06f4 with Priority: HIGHEST for action security_group_rules [ 582.433776] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68aca545-a440-43ea-9fd9-cee636cc06f4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.433776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68aca545-a440-43ea-9fd9-cee636cc06f4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.433776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68aca545-a440-43ea-9fd9-cee636cc06f4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.433776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68aca545-a440-43ea-9fd9-cee636cc06f4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.433776] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68aca545-a440-43ea-9fd9-cee636cc06f4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.462440] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.462619] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.462803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.462928] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.463864] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.723797] env[65359]: INFO networking_nsxv3.common.synchronization [None req-00cc80ab-9eb1-4fea-82eb-1360e13d3e2f None None] Enqueued Resource ID: 38b607f0-3f61-4a2c-a24f-f0246e267537 with Priority: HIGHEST for action port [ 582.725861] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b607f0-3f61-4a2c-a24f-f0246e267537 with Priority: HIGHEST for action port [ 582.726425] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-38b607f0-3f61-4a2c-a24f-f0246e267537 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.728450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38b607f0-3f61-4a2c-a24f-f0246e267537" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.728450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38b607f0-3f61-4a2c-a24f-f0246e267537" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.728450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38b607f0-3f61-4a2c-a24f-f0246e267537" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.728450] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38b607f0-3f61-4a2c-a24f-f0246e267537',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.949639] env[65359]: INFO networking_nsxv3.common.synchronization [None req-2fb0db59-9442-44bd-b81f-ba361f80fddc None None] Enqueued Resource ID: 7dcac188-18f5-4b80-9eed-98738d9d22b1 with Priority: HIGHEST for action port [ 582.950196] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dcac188-18f5-4b80-9eed-98738d9d22b1 with Priority: HIGHEST for action port [ 582.950519] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-7dcac188-18f5-4b80-9eed-98738d9d22b1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.950996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7dcac188-18f5-4b80-9eed-98738d9d22b1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.950996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7dcac188-18f5-4b80-9eed-98738d9d22b1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.950996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7dcac188-18f5-4b80-9eed-98738d9d22b1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.952048] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dcac188-18f5-4b80-9eed-98738d9d22b1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.957458] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.957626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.957655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.959407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.959407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.959407] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68aca545-a440-43ea-9fd9-cee636cc06f4 already deleted. [ 582.959407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68aca545-a440-43ea-9fd9-cee636cc06f4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.966749] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.229741] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38b607f0-3f61-4a2c-a24f-f0246e267537 [ 583.230331] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.230331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.230331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.230701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.230701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.230701] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38b607f0-3f61-4a2c-a24f-f0246e267537 already deleted. [ 583.230839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38b607f0-3f61-4a2c-a24f-f0246e267537" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.454139] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7dcac188-18f5-4b80-9eed-98738d9d22b1 [ 583.454387] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.454527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.454595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.454812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.454906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.454991] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7dcac188-18f5-4b80-9eed-98738d9d22b1 already deleted. [ 583.455088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7dcac188-18f5-4b80-9eed-98738d9d22b1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.469183] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.973702] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 583.973702] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 584.697133] env[65359]: INFO networking_nsxv3.common.synchronization [None req-d925e368-711f-4ef1-9474-a5a5a376335f None None] Enqueued Resource ID: 084ea374-e4ba-4598-895f-5b63530d0649 with Priority: HIGHEST for action port [ 584.697133] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 084ea374-e4ba-4598-895f-5b63530d0649 with Priority: HIGHEST for action port [ 584.697133] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-084ea374-e4ba-4598-895f-5b63530d0649 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.697133] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-084ea374-e4ba-4598-895f-5b63530d0649" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.697133] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-084ea374-e4ba-4598-895f-5b63530d0649" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.698285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-084ea374-e4ba-4598-895f-5b63530d0649" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.699206] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('084ea374-e4ba-4598-895f-5b63530d0649',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.821484] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.821484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.821484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.821736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.835208] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 584.835985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.836992] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 584.857906] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.857984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.858037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.858266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.858363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.858467] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 584.858536] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.858916] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 584.880261] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.880666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.880666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.880825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.880955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.881084] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 584.905192] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.906255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.906255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.906255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.906490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.906613] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 584.928013] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.928013] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.928751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.928751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.928751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.929610] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 584.929610] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.929610] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 584.951692] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.951692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.951692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.951692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.951692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.951960] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 584.951960] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.951960] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 584.978521] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.980666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.981072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.981207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.981828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.981828] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 584.981828] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.981828] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 584.981997] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 584.981997] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 584.982268] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 584.982268] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 584.982767] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 584.982936] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 584.983116] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 585.005706] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.005844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.005910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.006194] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.006275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.006410] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 585.027622] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.027761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.027831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.028058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.028164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.044752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.201816] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 084ea374-e4ba-4598-895f-5b63530d0649 [ 585.202130] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.202867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.202867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.202867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.202867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.202867] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:084ea374-e4ba-4598-895f-5b63530d0649 already deleted. [ 585.202867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-084ea374-e4ba-4598-895f-5b63530d0649" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.600545] env[65359]: INFO networking_nsxv3.common.synchronization [None req-398ed7b1-bb33-4e91-9b2d-c840ea339b4c None None] Enqueued Resource ID: 9d4b6b9b-714e-4671-8ab0-65e29f63f520 with Priority: HIGHEST for action port [ 585.600545] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d4b6b9b-714e-4671-8ab0-65e29f63f520 with Priority: HIGHEST for action port [ 585.601711] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d4b6b9b-714e-4671-8ab0-65e29f63f520 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.602047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d4b6b9b-714e-4671-8ab0-65e29f63f520" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.602255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d4b6b9b-714e-4671-8ab0-65e29f63f520" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.602673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d4b6b9b-714e-4671-8ab0-65e29f63f520" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.602890] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d4b6b9b-714e-4671-8ab0-65e29f63f520',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.107961] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d4b6b9b-714e-4671-8ab0-65e29f63f520 [ 586.107961] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.107961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.107961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.107961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.108515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.108515] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d4b6b9b-714e-4671-8ab0-65e29f63f520 already deleted. [ 586.108515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d4b6b9b-714e-4671-8ab0-65e29f63f520" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.704632] env[65359]: INFO networking_nsxv3.common.synchronization [None req-2ba7ea08-bec2-486c-ad32-fab34137e3e4 None None] Enqueued Resource ID: 71608707-3371-4d1d-87d0-53339427c255 with Priority: HIGHEST for action port [ 586.706035] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71608707-3371-4d1d-87d0-53339427c255 with Priority: HIGHEST for action port [ 586.706035] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-71608707-3371-4d1d-87d0-53339427c255 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.706035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71608707-3371-4d1d-87d0-53339427c255" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.706035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71608707-3371-4d1d-87d0-53339427c255" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.706035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71608707-3371-4d1d-87d0-53339427c255" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.706364] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71608707-3371-4d1d-87d0-53339427c255',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.034302] env[65359]: INFO networking_nsxv3.common.synchronization [None req-d26b4445-b1b9-4147-ad4f-c5880d43bcf4 None None] Enqueued Resource ID: 5381f4f6-8f0f-4ac0-8b77-c00654e8475d with Priority: HIGHEST for action port [ 587.037041] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5381f4f6-8f0f-4ac0-8b77-c00654e8475d with Priority: HIGHEST for action port [ 587.037041] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-5381f4f6-8f0f-4ac0-8b77-c00654e8475d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.037224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5381f4f6-8f0f-4ac0-8b77-c00654e8475d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.037224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5381f4f6-8f0f-4ac0-8b77-c00654e8475d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.037224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5381f4f6-8f0f-4ac0-8b77-c00654e8475d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.037224] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5381f4f6-8f0f-4ac0-8b77-c00654e8475d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.206025] env[65359]: INFO networking_nsxv3.common.synchronization [None req-60b37abf-05fc-4cf6-bc0e-604b7cdb75e1 tempest-ServerActionsTestJSON-975876043 tempest-ServerActionsTestJSON-975876043-project-member] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_rules [ 587.206619] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_rules [ 587.206921] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.207056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.207124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.207399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.207625] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.208428] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71608707-3371-4d1d-87d0-53339427c255 [ 587.208625] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.208747] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.209067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.209067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.209197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.209255] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71608707-3371-4d1d-87d0-53339427c255 already deleted. [ 587.209367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71608707-3371-4d1d-87d0-53339427c255" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.541629] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5381f4f6-8f0f-4ac0-8b77-c00654e8475d [ 587.542698] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.542698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.542698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.542698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.542698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.542698] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5381f4f6-8f0f-4ac0-8b77-c00654e8475d already deleted. [ 587.542698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5381f4f6-8f0f-4ac0-8b77-c00654e8475d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.732599] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.732599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.732599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.732599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.732599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.732599] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 already deleted. [ 587.732599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.266594] env[65359]: INFO networking_nsxv3.common.synchronization [None req-676e6b82-7031-4db4-b1be-be37f1486920 tempest-ServerActionsTestJSON-975876043 tempest-ServerActionsTestJSON-975876043-project-member] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_rules [ 588.267343] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_rules [ 588.268136] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.268277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.268277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.268660] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.268660] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.723444] env[65359]: INFO networking_nsxv3.common.synchronization [None req-89c95b18-fb9f-48bf-96e9-798a69610c10 None None] Enqueued Resource ID: 45b6ba68-a63b-442b-9338-8e5a5e16cff3 with Priority: HIGHEST for action port [ 588.723992] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45b6ba68-a63b-442b-9338-8e5a5e16cff3 with Priority: HIGHEST for action port [ 588.724306] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-45b6ba68-a63b-442b-9338-8e5a5e16cff3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.724434] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45b6ba68-a63b-442b-9338-8e5a5e16cff3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.724498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45b6ba68-a63b-442b-9338-8e5a5e16cff3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.726677] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45b6ba68-a63b-442b-9338-8e5a5e16cff3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.726677] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45b6ba68-a63b-442b-9338-8e5a5e16cff3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.792143] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.792316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.792388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.792593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.792685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.792777] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 already deleted. [ 588.792885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.229913] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45b6ba68-a63b-442b-9338-8e5a5e16cff3 [ 589.230366] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.230533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.230600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.230806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.230898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.230996] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45b6ba68-a63b-442b-9338-8e5a5e16cff3 already deleted. [ 589.231095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45b6ba68-a63b-442b-9338-8e5a5e16cff3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.686310] env[65359]: INFO networking_nsxv3.common.synchronization [None req-2977acce-29f3-4428-a0e1-31649e0f3d5b None None] Enqueued Resource ID: 1148dad2-78cb-447b-9127-3c7a2c96bc5b with Priority: HIGHEST for action port [ 589.686310] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1148dad2-78cb-447b-9127-3c7a2c96bc5b with Priority: HIGHEST for action port [ 589.686310] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-1148dad2-78cb-447b-9127-3c7a2c96bc5b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.686310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1148dad2-78cb-447b-9127-3c7a2c96bc5b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.686310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1148dad2-78cb-447b-9127-3c7a2c96bc5b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.687146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1148dad2-78cb-447b-9127-3c7a2c96bc5b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.687306] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1148dad2-78cb-447b-9127-3c7a2c96bc5b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.701771] env[65359]: INFO networking_nsxv3.common.synchronization [None req-a4509ce8-036b-4483-8ee9-1fb1f5ff311f None None] Enqueued Resource ID: 62364de3-f812-4c47-adf8-1c26f2f4c491 with Priority: HIGHEST for action port [ 589.701856] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62364de3-f812-4c47-adf8-1c26f2f4c491 with Priority: HIGHEST for action port [ 589.703103] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-62364de3-f812-4c47-adf8-1c26f2f4c491 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.703103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62364de3-f812-4c47-adf8-1c26f2f4c491" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.703103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62364de3-f812-4c47-adf8-1c26f2f4c491" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.703103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62364de3-f812-4c47-adf8-1c26f2f4c491" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.703103] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62364de3-f812-4c47-adf8-1c26f2f4c491',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.190858] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1148dad2-78cb-447b-9127-3c7a2c96bc5b [ 590.192436] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.192436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.192436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.192436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.192436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.192436] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1148dad2-78cb-447b-9127-3c7a2c96bc5b already deleted. [ 590.192436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1148dad2-78cb-447b-9127-3c7a2c96bc5b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.205287] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62364de3-f812-4c47-adf8-1c26f2f4c491 [ 590.206673] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.206673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.206673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.206673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.206973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.207191] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62364de3-f812-4c47-adf8-1c26f2f4c491 already deleted. [ 590.207395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62364de3-f812-4c47-adf8-1c26f2f4c491" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.612198] env[65359]: INFO networking_nsxv3.common.synchronization [req-f59f1dd1-22ca-46e6-83c0-9e0eb213e33e req-e37a3cb9-da04-4f36-abce-82ecee36c655 tempest-FloatingIPsAssociationTestJSON-809440522 tempest-FloatingIPsAssociationTestJSON-809440522-project-member] Enqueued Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_members [ 590.612198] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_members [ 590.612198] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.612198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.612198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.612425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.612638] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.612716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.612755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.612883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.612970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.613300] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.670863] env[65359]: INFO networking_nsxv3.common.synchronization [req-352176a6-066f-4ecf-bca2-2aa03b84d219 req-62c92e31-58a4-45b6-b2a5-afca36266cdf tempest-SecurityGroupRulesNegativeTestJSON-816495707 tempest-SecurityGroupRulesNegativeTestJSON-816495707-project-member] Enqueued Resource ID: 68aca545-a440-43ea-9fd9-cee636cc06f4 with Priority: HIGHEST for action security_group_rules [ 590.671543] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68aca545-a440-43ea-9fd9-cee636cc06f4 with Priority: HIGHEST for action security_group_rules [ 590.671839] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68aca545-a440-43ea-9fd9-cee636cc06f4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.674099] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68aca545-a440-43ea-9fd9-cee636cc06f4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.674099] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68aca545-a440-43ea-9fd9-cee636cc06f4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.674099] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68aca545-a440-43ea-9fd9-cee636cc06f4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.674099] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68aca545-a440-43ea-9fd9-cee636cc06f4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.066985] env[65359]: INFO networking_nsxv3.common.synchronization [None req-8909cb02-b126-47d2-8a9b-8602f28f6d0a None None] Enqueued Resource ID: ca6e0b1e-15b2-4450-9611-503a8d2a1414 with Priority: HIGHEST for action port [ 591.067590] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6e0b1e-15b2-4450-9611-503a8d2a1414 with Priority: HIGHEST for action port [ 591.067997] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca6e0b1e-15b2-4450-9611-503a8d2a1414 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.069138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca6e0b1e-15b2-4450-9611-503a8d2a1414" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.069138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca6e0b1e-15b2-4450-9611-503a8d2a1414" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.069138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca6e0b1e-15b2-4450-9611-503a8d2a1414" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.069138] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca6e0b1e-15b2-4450-9611-503a8d2a1414',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.117641] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.117823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.117910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.118221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.118335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.118497] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.118601] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.118663] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.118824] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.118926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.119078] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6cbdd6f-4665-46af-8251-3803d47cff8b already deleted. [ 591.119120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.196996] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.196996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.196996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.196996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.196996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.196996] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68aca545-a440-43ea-9fd9-cee636cc06f4 already deleted. [ 591.196996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68aca545-a440-43ea-9fd9-cee636cc06f4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.330508] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-184 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.330739] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-184" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.330859] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-184" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.331168] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-184" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.331429] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.331584] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.331718] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.331935] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.332118] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.332421] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.332572] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.335367] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.335367] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.335367] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.335367] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.335367] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.353454] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.353454] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 591.353599] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.353982] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-184" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.354148] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-5fe2fa0e-c175-4fe7-bc04-9001ca928475 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.354664] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-5fe2fa0e-c175-4fe7-bc04-9001ca928475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.354664] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-5fe2fa0e-c175-4fe7-bc04-9001ca928475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.354780] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-5fe2fa0e-c175-4fe7-bc04-9001ca928475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.354879] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fe2fa0e-c175-4fe7-bc04-9001ca928475',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.572342] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca6e0b1e-15b2-4450-9611-503a8d2a1414 [ 591.572636] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.572782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.572854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.573081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.573176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.573272] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca6e0b1e-15b2-4450-9611-503a8d2a1414 already deleted. [ 591.573353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca6e0b1e-15b2-4450-9611-503a8d2a1414" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.859467] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.859702] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.859823] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.860111] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.860254] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.860488] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 5fe2fa0e-c175-4fe7-bc04-9001ca928475 not found, creating... [ 591.860737] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.860894] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.861008] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.861222] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.861349] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.861705] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.861855] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.861966] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.862593] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.862703] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.862837] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 5fe2fa0e-c175-4fe7-bc04-9001ca928475 is going to be created. [ 591.887352] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.887845] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.888276] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.889434] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.890347] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.890577] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-5fe2fa0e-c175-4fe7-bc04-9001ca928475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.069818] env[65359]: INFO networking_nsxv3.common.synchronization [None req-77f44712-50a1-4ba3-8339-ee90cf3d004d None None] Enqueued Resource ID: fbd692ea-1d38-4a3c-ba93-36e4fc850ab2 with Priority: HIGHEST for action port [ 592.072842] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbd692ea-1d38-4a3c-ba93-36e4fc850ab2 with Priority: HIGHEST for action port [ 592.074324] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbd692ea-1d38-4a3c-ba93-36e4fc850ab2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.074324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbd692ea-1d38-4a3c-ba93-36e4fc850ab2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.074324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbd692ea-1d38-4a3c-ba93-36e4fc850ab2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.074324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbd692ea-1d38-4a3c-ba93-36e4fc850ab2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.074324] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbd692ea-1d38-4a3c-ba93-36e4fc850ab2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.577036] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbd692ea-1d38-4a3c-ba93-36e4fc850ab2 [ 592.577235] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.579343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.579546] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.581466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.581575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.582294] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbd692ea-1d38-4a3c-ba93-36e4fc850ab2 already deleted. [ 592.582294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbd692ea-1d38-4a3c-ba93-36e4fc850ab2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.761687] env[65359]: INFO networking_nsxv3.common.synchronization [req-f59f1dd1-22ca-46e6-83c0-9e0eb213e33e req-a8475eca-dfa9-4f27-8547-aae47a5ae7c1 service nova] Enqueued Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_rules [ 592.761687] env[65359]: INFO networking_nsxv3.common.synchronization [req-f59f1dd1-22ca-46e6-83c0-9e0eb213e33e req-a8475eca-dfa9-4f27-8547-aae47a5ae7c1 service nova] Enqueued Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_members [ 592.761687] env[65359]: INFO networking_nsxv3.common.synchronization [req-f59f1dd1-22ca-46e6-83c0-9e0eb213e33e req-a8475eca-dfa9-4f27-8547-aae47a5ae7c1 service nova] Enqueued Resource ID: 5fe2fa0e-c175-4fe7-bc04-9001ca928475 with Priority: HIGHEST for action port [ 592.761687] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_rules [ 592.761687] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_members [ 592.761687] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fe2fa0e-c175-4fe7-bc04-9001ca928475 with Priority: HIGHEST for action port [ 592.765879] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.765879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.765879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.765879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.765879] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.765879] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.765879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.765879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.765879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.765879] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.765879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.765879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.766390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.766390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.766390] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.770066] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fe2fa0e-c175-4fe7-bc04-9001ca928475 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.770205] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fe2fa0e-c175-4fe7-bc04-9001ca928475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.770260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fe2fa0e-c175-4fe7-bc04-9001ca928475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.771157] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fe2fa0e-c175-4fe7-bc04-9001ca928475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.771157] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fe2fa0e-c175-4fe7-bc04-9001ca928475',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.270465] env[65359]: INFO networking_nsxv3.common.synchronization [None req-f00daf8d-a23f-4fca-a17b-1eaf89a7b14b None None] Enqueued Resource ID: 164153ed-ecaa-407a-934c-06e7a20d86f0 with Priority: HIGHEST for action port [ 593.270977] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 164153ed-ecaa-407a-934c-06e7a20d86f0 with Priority: HIGHEST for action port [ 593.271366] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-164153ed-ecaa-407a-934c-06e7a20d86f0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.271431] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-164153ed-ecaa-407a-934c-06e7a20d86f0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.271476] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-164153ed-ecaa-407a-934c-06e7a20d86f0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.271718] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-164153ed-ecaa-407a-934c-06e7a20d86f0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.271791] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('164153ed-ecaa-407a-934c-06e7a20d86f0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.275290] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.275290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.284162] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.284819] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fe2fa0e-c175-4fe7-bc04-9001ca928475 with status ACTIVE [ 593.289253] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.289253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.289253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.289253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.289253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.289253] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.289253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.289253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.289253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.289253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.289253] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.289253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.289253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.289253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.289253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.289253] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fe2fa0e-c175-4fe7-bc04-9001ca928475 is going to be updated. [ 593.316765] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.316765] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.316957] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.317066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.317208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.317399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fe2fa0e-c175-4fe7-bc04-9001ca928475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.774328] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 164153ed-ecaa-407a-934c-06e7a20d86f0 [ 593.774328] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.774328] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.774533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.774758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.774853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.774950] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:164153ed-ecaa-407a-934c-06e7a20d86f0 already deleted. [ 593.775044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-164153ed-ecaa-407a-934c-06e7a20d86f0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.793209] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.298379] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.298721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.298721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.299596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.299596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.299596] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6cbdd6f-4665-46af-8251-3803d47cff8b is going to be created. [ 594.329617] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.329792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.329830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.330299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.330299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.342922] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6cbdd6f-4665-46af-8251-3803d47cff8b in Status: UNINITIALIZED for 2s [ 595.411781] env[65359]: INFO networking_nsxv3.common.synchronization [None req-0dea04eb-37b9-4f5a-9cc7-afd28a8c5e33 tempest-VolumesAssistedSnapshotsTest-1704132221 tempest-VolumesAssistedSnapshotsTest-1704132221-project-member] Enqueued Resource ID: 505f1bca-748c-4f56-9f01-2a595d335a84 with Priority: HIGHEST for action security_group_rules [ 595.413243] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505f1bca-748c-4f56-9f01-2a595d335a84 with Priority: HIGHEST for action security_group_rules [ 595.413243] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-505f1bca-748c-4f56-9f01-2a595d335a84 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.414874] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.414874] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.414874] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.414874] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('505f1bca-748c-4f56-9f01-2a595d335a84',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.807693] env[65359]: INFO networking_nsxv3.common.synchronization [None req-fa15f642-f744-42e3-b8d5-7df9c333026d None None] Enqueued Resource ID: 1559c9dd-5e71-4803-b201-e09c385a5538 with Priority: HIGHEST for action port [ 595.808373] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1559c9dd-5e71-4803-b201-e09c385a5538 with Priority: HIGHEST for action port [ 595.808524] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-1559c9dd-5e71-4803-b201-e09c385a5538 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.808524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1559c9dd-5e71-4803-b201-e09c385a5538" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.808621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1559c9dd-5e71-4803-b201-e09c385a5538" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.808898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1559c9dd-5e71-4803-b201-e09c385a5538" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.808898] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1559c9dd-5e71-4803-b201-e09c385a5538',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.941595] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.941595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.941595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.941595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.941595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.941595] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 505f1bca-748c-4f56-9f01-2a595d335a84 already deleted. [ 595.941595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.268712] env[65359]: INFO networking_nsxv3.common.synchronization [req-341cf35d-cb77-41df-9e37-113e9d13c3db req-9795512b-b20a-4600-afd3-dc9b474371e2 tempest-DeleteServersAdminTestJSON-1164442439 tempest-DeleteServersAdminTestJSON-1164442439-project-member] Enqueued Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_members [ 596.269308] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_members [ 596.269632] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c01e6ff-b831-4d21-8c9a-e3a067190d76 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.272928] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.273073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.273350] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.273534] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.273760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.273830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.274058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.274194] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.275199] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.313602] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1559c9dd-5e71-4803-b201-e09c385a5538 [ 596.314008] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.314163] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.314266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.314502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.314639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.314765] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1559c9dd-5e71-4803-b201-e09c385a5538 already deleted. [ 596.314858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1559c9dd-5e71-4803-b201-e09c385a5538" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.354836] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6cbdd6f-4665-46af-8251-3803d47cff8b in Status: SUCCESS [ 596.355132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.355346] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.357247] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.357554] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.357799] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.357799] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.358027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.358113] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.358207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.358307] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.363179] env[65359]: INFO networking_nsxv3.common.synchronization [None req-9e9e8d82-dbb8-4282-b359-f504f0926f16 None None] Enqueued Resource ID: d4ed79aa-485b-421b-bec7-df7bda90ea39 with Priority: HIGHEST for action port [ 596.363952] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ed79aa-485b-421b-bec7-df7bda90ea39 with Priority: HIGHEST for action port [ 596.365746] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4ed79aa-485b-421b-bec7-df7bda90ea39 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.365884] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4ed79aa-485b-421b-bec7-df7bda90ea39" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.365971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4ed79aa-485b-421b-bec7-df7bda90ea39" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.366222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4ed79aa-485b-421b-bec7-df7bda90ea39" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.366306] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4ed79aa-485b-421b-bec7-df7bda90ea39',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.511900] env[65359]: INFO networking_nsxv3.common.synchronization [None req-8ee17610-768d-4086-b95c-174c1e4fa72b tempest-VolumesAssistedSnapshotsTest-1704132221 tempest-VolumesAssistedSnapshotsTest-1704132221-project-member] Enqueued Resource ID: 505f1bca-748c-4f56-9f01-2a595d335a84 with Priority: HIGHEST for action security_group_rules [ 596.512243] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505f1bca-748c-4f56-9f01-2a595d335a84 with Priority: HIGHEST for action security_group_rules [ 596.514761] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-505f1bca-748c-4f56-9f01-2a595d335a84 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.514761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.514761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.514761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.514761] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('505f1bca-748c-4f56-9f01-2a595d335a84',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.693074] env[65359]: INFO networking_nsxv3.common.synchronization [None req-5f213866-afac-48e7-a54b-3d0a0b454273 None None] Enqueued Resource ID: 05290c4c-8942-4a34-bef3-508c02f70554 with Priority: HIGHEST for action port [ 596.693592] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05290c4c-8942-4a34-bef3-508c02f70554 with Priority: HIGHEST for action port [ 596.693888] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-05290c4c-8942-4a34-bef3-508c02f70554 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.694174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05290c4c-8942-4a34-bef3-508c02f70554" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.694174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05290c4c-8942-4a34-bef3-508c02f70554" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.694347] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05290c4c-8942-4a34-bef3-508c02f70554" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.694432] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05290c4c-8942-4a34-bef3-508c02f70554',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.779122] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.779315] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.779361] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.780354] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.780354] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.780642] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.780778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.780845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.781132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.781326] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.781326] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 already deleted. [ 596.781450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.865344] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.865344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.865344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.865653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.865691] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.866307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.866307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.866307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.866307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.866307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.866556] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.866556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.866556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.866667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.866822] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.866916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.867022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.867149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.867251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.867318] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.867522] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.870149] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4ed79aa-485b-421b-bec7-df7bda90ea39 [ 596.870149] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.870149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.870149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.870149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.870149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.870149] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4ed79aa-485b-421b-bec7-df7bda90ea39 already deleted. [ 596.870149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4ed79aa-485b-421b-bec7-df7bda90ea39" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.920722] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.920963] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.921054] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.921526] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.921960] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.922126] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.922238] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.922485] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.924156] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.924156] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.924156] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 596.924156] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 596.924156] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 596.924156] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.924156] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 596.924156] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 596.944863] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 596.945106] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 596.945280] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 596.945468] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.946099] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-cd732c09-306d-4d7f-b823-77d5f31e2df4 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.946099] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-cd732c09-306d-4d7f-b823-77d5f31e2df4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.946302] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-cd732c09-306d-4d7f-b823-77d5f31e2df4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.946474] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-cd732c09-306d-4d7f-b823-77d5f31e2df4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.946606] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd732c09-306d-4d7f-b823-77d5f31e2df4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.037813] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.037978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.038062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.038282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.038376] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.038471] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 505f1bca-748c-4f56-9f01-2a595d335a84 already deleted. [ 597.038556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.198767] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05290c4c-8942-4a34-bef3-508c02f70554 [ 597.199969] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.199969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.199969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.199969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.199969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.199969] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05290c4c-8942-4a34-bef3-508c02f70554 already deleted. [ 597.199969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05290c4c-8942-4a34-bef3-508c02f70554" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.373027] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6cbdd6f-4665-46af-8251-3803d47cff8b: rpc.has_security_group_logging(os_id): False [ 597.392033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.392033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.392033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.392033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.392033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.392033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.392033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.392033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.392033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.392033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.392033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.392033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.392033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.392033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.392033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.392678] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.392678] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.392678] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.392678] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.392678] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.392678] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6cbdd6f-4665-46af-8251-3803d47cff8b is going to be created. [ 597.453030] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.453030] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.453030] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.453030] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.453030] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.453030] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port cd732c09-306d-4d7f-b823-77d5f31e2df4 not found, creating... [ 597.453030] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.453030] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.453030] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.453030] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.453030] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.453663] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.453663] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.453663] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.453663] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.453663] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.453663] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: cd732c09-306d-4d7f-b823-77d5f31e2df4 is going to be created. [ 597.457192] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.457524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.457696] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.457921] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.458204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.475075] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6cbdd6f-4665-46af-8251-3803d47cff8b in Status: IN_PROGRESS for 2s [ 597.482250] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.482443] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.482561] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.482832] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.483058] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.483293] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-cd732c09-306d-4d7f-b823-77d5f31e2df4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.558149] env[65359]: INFO networking_nsxv3.common.synchronization [None req-cc625a56-3100-4bc6-8930-5a314394b62d None None] Enqueued Resource ID: 862a41bd-056c-400b-8c8a-e4adee23b81a with Priority: HIGHEST for action port [ 597.558441] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 862a41bd-056c-400b-8c8a-e4adee23b81a with Priority: HIGHEST for action port [ 597.558559] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-862a41bd-056c-400b-8c8a-e4adee23b81a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.558631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-862a41bd-056c-400b-8c8a-e4adee23b81a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.558679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-862a41bd-056c-400b-8c8a-e4adee23b81a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.558928] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-862a41bd-056c-400b-8c8a-e4adee23b81a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.559023] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('862a41bd-056c-400b-8c8a-e4adee23b81a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.063318] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 862a41bd-056c-400b-8c8a-e4adee23b81a [ 598.063318] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.063318] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.063318] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.063318] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.063318] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.063318] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:862a41bd-056c-400b-8c8a-e4adee23b81a already deleted. [ 598.063318] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-862a41bd-056c-400b-8c8a-e4adee23b81a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.377176] env[65359]: INFO networking_nsxv3.common.synchronization [req-fc71466f-6b4c-48c4-910f-55fa69830d10 req-588df7ea-7d83-485d-bb6d-61edfae6a0a5 tempest-ServerDiagnosticsTest-1007112282 tempest-ServerDiagnosticsTest-1007112282-project-member] Enqueued Resource ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 with Priority: HIGHEST for action security_group_members [ 598.377176] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 with Priority: HIGHEST for action security_group_members [ 598.377176] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c053aa73-c45e-4ff7-9c78-5faef3e76294 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.377176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.377176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.377176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.377493] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.377641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.377690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.377874] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.377969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.378066] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c053aa73-c45e-4ff7-9c78-5faef3e76294',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.416090] env[65359]: INFO networking_nsxv3.common.synchronization [req-341cf35d-cb77-41df-9e37-113e9d13c3db req-7440b6fe-e66a-4fb5-b2f5-67a83d960b05 service nova] Enqueued Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_rules [ 598.416090] env[65359]: INFO networking_nsxv3.common.synchronization [req-341cf35d-cb77-41df-9e37-113e9d13c3db req-7440b6fe-e66a-4fb5-b2f5-67a83d960b05 service nova] Enqueued Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_members [ 598.416090] env[65359]: INFO networking_nsxv3.common.synchronization [req-341cf35d-cb77-41df-9e37-113e9d13c3db req-7440b6fe-e66a-4fb5-b2f5-67a83d960b05 service nova] Enqueued Resource ID: cd732c09-306d-4d7f-b823-77d5f31e2df4 with Priority: HIGHEST for action port [ 598.419530] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_rules [ 598.419530] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_members [ 598.419530] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd732c09-306d-4d7f-b823-77d5f31e2df4 with Priority: HIGHEST for action port [ 598.419530] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c01e6ff-b831-4d21-8c9a-e3a067190d76 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.419530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.419530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.419752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.419788] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.420670] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c01e6ff-b831-4d21-8c9a-e3a067190d76 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.420785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.421049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.421049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.421987] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.421987] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.421987] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.422170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.422200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.422272] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.423044] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd732c09-306d-4d7f-b823-77d5f31e2df4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.423144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd732c09-306d-4d7f-b823-77d5f31e2df4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.423279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd732c09-306d-4d7f-b823-77d5f31e2df4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.423353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd732c09-306d-4d7f-b823-77d5f31e2df4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.423448] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd732c09-306d-4d7f-b823-77d5f31e2df4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.883847] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.884104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.884104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.884292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.884377] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.884571] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.884666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.884725] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.884870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.884942] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.885040] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 already deleted. [ 598.885139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.925954] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c01e6ff-b831-4d21-8c9a-e3a067190d76 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.925954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.925954] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.926964] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd732c09-306d-4d7f-b823-77d5f31e2df4 with status ACTIVE [ 598.926964] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.927227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.927227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.927367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.927367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.927600] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.927688] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.927737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.927857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.927930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.928128] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.928492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.928492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.928492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.928492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.928647] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd732c09-306d-4d7f-b823-77d5f31e2df4 is going to be updated. [ 598.955321] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.955579] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.955661] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.955879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.956069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.956661] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd732c09-306d-4d7f-b823-77d5f31e2df4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.009062] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.009334] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.009509] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.009699] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.009927] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.010089] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.010196] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.010396] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.010592] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.010804] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.010895] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.010995] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.011107] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.011204] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.011297] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.011418] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.037020] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.037020] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 599.037020] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.037020] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.037020] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-4e21d545-6f95-4725-9882-b106a172f4b7 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.038083] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-4e21d545-6f95-4725-9882-b106a172f4b7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.038083] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-4e21d545-6f95-4725-9882-b106a172f4b7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.038204] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-4e21d545-6f95-4725-9882-b106a172f4b7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.038335] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e21d545-6f95-4725-9882-b106a172f4b7',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.431927] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.493670] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6cbdd6f-4665-46af-8251-3803d47cff8b in Status: SUCCESS [ 599.494029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.541506] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.541651] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.542129] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.542250] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.542453] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.542661] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 4e21d545-6f95-4725-9882-b106a172f4b7 not found, creating... [ 599.543246] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.543732] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.543732] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.543838] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.543948] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.544342] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.544422] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.544533] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.544771] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.544910] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.545171] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 4e21d545-6f95-4725-9882-b106a172f4b7 is going to be created. [ 599.567795] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.568155] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.568367] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.568800] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.569104] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.569502] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-4e21d545-6f95-4725-9882-b106a172f4b7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.935988] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.936403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.936403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.936711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.936711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.936711] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 is going to be created. [ 599.961899] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.962095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.962166] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.962394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.962489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.972149] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 in Status: UNINITIALIZED for 2s [ 600.291052] env[65359]: INFO networking_nsxv3.common.synchronization [req-fc71466f-6b4c-48c4-910f-55fa69830d10 req-39d93f25-4aac-47e9-92cd-c0d61fec586f service nova] Enqueued Resource ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 with Priority: HIGHEST for action security_group_rules [ 600.291052] env[65359]: INFO networking_nsxv3.common.synchronization [req-fc71466f-6b4c-48c4-910f-55fa69830d10 req-39d93f25-4aac-47e9-92cd-c0d61fec586f service nova] Enqueued Resource ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 with Priority: HIGHEST for action security_group_members [ 600.291052] env[65359]: INFO networking_nsxv3.common.synchronization [req-fc71466f-6b4c-48c4-910f-55fa69830d10 req-39d93f25-4aac-47e9-92cd-c0d61fec586f service nova] Enqueued Resource ID: 4e21d545-6f95-4725-9882-b106a172f4b7 with Priority: HIGHEST for action port [ 600.291052] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 with Priority: HIGHEST for action security_group_rules [ 600.291275] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 with Priority: HIGHEST for action security_group_members [ 600.291386] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e21d545-6f95-4725-9882-b106a172f4b7 with Priority: HIGHEST for action port [ 600.291743] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c053aa73-c45e-4ff7-9c78-5faef3e76294 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.291933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.295023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.295023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.295023] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c053aa73-c45e-4ff7-9c78-5faef3e76294',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.295023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c053aa73-c45e-4ff7-9c78-5faef3e76294 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.295023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.295023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.295023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.295023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.295023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.295023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.295528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.295528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.295528] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c053aa73-c45e-4ff7-9c78-5faef3e76294',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.296410] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e21d545-6f95-4725-9882-b106a172f4b7 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.296546] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e21d545-6f95-4725-9882-b106a172f4b7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.296687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e21d545-6f95-4725-9882-b106a172f4b7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.297045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e21d545-6f95-4725-9882-b106a172f4b7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.297045] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e21d545-6f95-4725-9882-b106a172f4b7',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.437078] env[65359]: INFO networking_nsxv3.common.synchronization [None req-13fd0914-fa82-4b79-8702-3e7ceda1caae None None] Enqueued Resource ID: 7e730b8b-dccf-4398-b41a-386fb9a1d0f0 with Priority: HIGHEST for action port [ 600.437959] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e730b8b-dccf-4398-b41a-386fb9a1d0f0 with Priority: HIGHEST for action port [ 600.440347] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e730b8b-dccf-4398-b41a-386fb9a1d0f0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.440644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e730b8b-dccf-4398-b41a-386fb9a1d0f0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.440644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e730b8b-dccf-4398-b41a-386fb9a1d0f0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.440846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e730b8b-dccf-4398-b41a-386fb9a1d0f0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.440935] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e730b8b-dccf-4398-b41a-386fb9a1d0f0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.802056] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c053aa73-c45e-4ff7-9c78-5faef3e76294 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.802056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.802056] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c053aa73-c45e-4ff7-9c78-5faef3e76294',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.802441] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e21d545-6f95-4725-9882-b106a172f4b7 with status ACTIVE [ 600.802441] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.802441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.802861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.802861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.802861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.802970] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.803104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.803148] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.804014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.804014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.804014] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.804014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.804014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.804014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.804014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.804014] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e21d545-6f95-4725-9882-b106a172f4b7 is going to be updated. [ 600.827439] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.827575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.827613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.827835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.827979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.828202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e21d545-6f95-4725-9882-b106a172f4b7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.944185] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e730b8b-dccf-4398-b41a-386fb9a1d0f0 [ 600.944542] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.944667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.944731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.944956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.945058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.945154] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e730b8b-dccf-4398-b41a-386fb9a1d0f0 already deleted. [ 600.945263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e730b8b-dccf-4398-b41a-386fb9a1d0f0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.959978] env[65359]: INFO networking_nsxv3.common.synchronization [None req-0f90f827-b0fa-4fe5-b0d5-81b052478426 None None] Enqueued Resource ID: a90e76db-008a-4561-808c-a7f40a99092a with Priority: HIGHEST for action port [ 600.960815] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a90e76db-008a-4561-808c-a7f40a99092a with Priority: HIGHEST for action port [ 600.961325] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-a90e76db-008a-4561-808c-a7f40a99092a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.961486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a90e76db-008a-4561-808c-a7f40a99092a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.961904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a90e76db-008a-4561-808c-a7f40a99092a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.961984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a90e76db-008a-4561-808c-a7f40a99092a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.962387] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a90e76db-008a-4561-808c-a7f40a99092a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.139695] env[65359]: INFO networking_nsxv3.common.synchronization [req-3c5214c8-d389-4183-91cf-81f02e596ae3 req-c8f62a23-53c4-4ea7-a394-1f1203d37a4e tempest-MigrationsAdminTest-860872539 tempest-MigrationsAdminTest-860872539-project-member] Enqueued Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_members [ 601.139695] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_members [ 601.139695] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.139695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.139695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.139695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.139695] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.139695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.139695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.140148] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.140148] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.140148] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.306582] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c053aa73-c45e-4ff7-9c78-5faef3e76294',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.465058] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a90e76db-008a-4561-808c-a7f40a99092a [ 601.465399] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.465597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.465706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.466011] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.466159] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.466301] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a90e76db-008a-4561-808c-a7f40a99092a already deleted. [ 601.466428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a90e76db-008a-4561-808c-a7f40a99092a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.643632] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.643828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.643866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.644133] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.644182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.645112] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.645112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.645112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.645112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.645112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.645112] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09044820-85da-426b-b103-26678a0652e6 already deleted. [ 601.645112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.809411] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.809691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.809767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.809996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.810105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.810219] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 is going to be created. [ 601.837028] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.837028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.837455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.837975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.838232] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.850708] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 in Status: UNINITIALIZED for 2s [ 601.983552] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 in Status: SUCCESS [ 601.983795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.983833] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.984150] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.984271] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.984396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.984821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.984821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.984821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.985292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.985292] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.081306] env[65359]: INFO networking_nsxv3.common.synchronization [None req-c1378ed7-d7b9-45be-8254-81e884385e52 None None] Enqueued Resource ID: cf24c8b9-e54b-40c1-8448-551b16e4a1ba with Priority: HIGHEST for action port [ 602.081306] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf24c8b9-e54b-40c1-8448-551b16e4a1ba with Priority: HIGHEST for action port [ 602.082212] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf24c8b9-e54b-40c1-8448-551b16e4a1ba taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.082343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf24c8b9-e54b-40c1-8448-551b16e4a1ba" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.082436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf24c8b9-e54b-40c1-8448-551b16e4a1ba" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.082715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf24c8b9-e54b-40c1-8448-551b16e4a1ba" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.082800] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf24c8b9-e54b-40c1-8448-551b16e4a1ba',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.359169] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.359379] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.359527] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.359763] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.360034] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.360193] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.360301] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.360516] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.360648] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.360856] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.360958] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.361940] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.362107] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.362235] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.362343] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.362473] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.383701] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.383865] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.384015] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.384196] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.384564] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-253370fa-267b-40ea-a181-23b1092098fd taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.385829] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-253370fa-267b-40ea-a181-23b1092098fd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.385829] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-253370fa-267b-40ea-a181-23b1092098fd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.385829] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-253370fa-267b-40ea-a181-23b1092098fd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.385829] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('253370fa-267b-40ea-a181-23b1092098fd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.493367] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c01e6ff-b831-4d21-8c9a-e3a067190d76 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.493367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.493367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.493367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.493367] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.493367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.493367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.493367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.493367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.493367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.493367] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c01e6ff-b831-4d21-8c9a-e3a067190d76 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.493367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.493367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.493367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.493367] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.493367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.494183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.494183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.494183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.494183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.494183] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.550794] env[65359]: INFO networking_nsxv3.common.synchronization [None req-7cb9a205-7f4d-446c-a81d-007f3ecbcf66 None None] Enqueued Resource ID: 2b2173b4-7b7e-44bc-93ca-5dfef057aba3 with Priority: HIGHEST for action port [ 602.551336] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b2173b4-7b7e-44bc-93ca-5dfef057aba3 with Priority: HIGHEST for action port [ 602.551615] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b2173b4-7b7e-44bc-93ca-5dfef057aba3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.551748] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b2173b4-7b7e-44bc-93ca-5dfef057aba3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.551848] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b2173b4-7b7e-44bc-93ca-5dfef057aba3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.552199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b2173b4-7b7e-44bc-93ca-5dfef057aba3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.552293] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b2173b4-7b7e-44bc-93ca-5dfef057aba3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.585639] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf24c8b9-e54b-40c1-8448-551b16e4a1ba [ 602.585901] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.586029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.586098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.586760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.586874] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.586997] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf24c8b9-e54b-40c1-8448-551b16e4a1ba already deleted. [ 602.587116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf24c8b9-e54b-40c1-8448-551b16e4a1ba" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.888300] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.889069] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.889230] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.889568] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.889732] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.889888] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 253370fa-267b-40ea-a181-23b1092098fd not found, creating... [ 602.890187] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.890361] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.890450] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.890690] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.890823] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.895718] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.895718] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.895718] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.895978] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.896465] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.896465] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 253370fa-267b-40ea-a181-23b1092098fd is going to be created. [ 602.919332] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.919590] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.919679] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.919972] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.920194] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.920417] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-253370fa-267b-40ea-a181-23b1092098fd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.995964] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c01e6ff-b831-4d21-8c9a-e3a067190d76: rpc.has_security_group_logging(os_id): False [ 603.031206] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.031439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.031439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.033027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.033027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.033027] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.033027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.033027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.033027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.033027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.033027] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.033027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.033027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.033027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.033537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.033572] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.033694] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.033804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.033973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.034043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.034136] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 is going to be created. [ 603.056181] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b2173b4-7b7e-44bc-93ca-5dfef057aba3 [ 603.056181] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.056181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.056623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.056800] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.057242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.057420] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b2173b4-7b7e-44bc-93ca-5dfef057aba3 already deleted. [ 603.057549] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b2173b4-7b7e-44bc-93ca-5dfef057aba3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.111119] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.111299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.111364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.111545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.111727] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.127227] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 in Status: IN_PROGRESS for 2s [ 603.607383] env[65359]: INFO networking_nsxv3.common.synchronization [req-3c5214c8-d389-4183-91cf-81f02e596ae3 req-922ac385-7b48-47cc-8e64-0bca68ecca80 service nova] Enqueued Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_rules [ 603.607383] env[65359]: INFO networking_nsxv3.common.synchronization [req-3c5214c8-d389-4183-91cf-81f02e596ae3 req-922ac385-7b48-47cc-8e64-0bca68ecca80 service nova] Enqueued Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_members [ 603.607383] env[65359]: INFO networking_nsxv3.common.synchronization [req-3c5214c8-d389-4183-91cf-81f02e596ae3 req-922ac385-7b48-47cc-8e64-0bca68ecca80 service nova] Enqueued Resource ID: 253370fa-267b-40ea-a181-23b1092098fd with Priority: HIGHEST for action port [ 603.607383] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_rules [ 603.607383] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_members [ 603.607383] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 253370fa-267b-40ea-a181-23b1092098fd with Priority: HIGHEST for action port [ 603.607383] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.607383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.608065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.608519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.608730] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.610073] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.610335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.610520] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.610860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.611151] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.611379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.611548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.612082] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.612082] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.612082] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.613087] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-253370fa-267b-40ea-a181-23b1092098fd taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.613395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-253370fa-267b-40ea-a181-23b1092098fd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.615091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-253370fa-267b-40ea-a181-23b1092098fd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.615091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-253370fa-267b-40ea-a181-23b1092098fd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.615091] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('253370fa-267b-40ea-a181-23b1092098fd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.864578] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 in Status: SUCCESS [ 603.864818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.864986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.865230] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.865418] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.865538] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.865605] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.865773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.865888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.865986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.866088] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c053aa73-c45e-4ff7-9c78-5faef3e76294',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.892432] env[65359]: INFO networking_nsxv3.common.synchronization [req-49ce461e-3b56-491c-817d-6af2204590f7 req-36dbf223-6e33-4248-b728-0024fedb59bb tempest-ServersAdminTestJSON-387763736 tempest-ServersAdminTestJSON-387763736-project-member] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 603.892948] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 603.894431] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.894602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.894676] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.894932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.895150] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.895305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.895411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.895581] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.895673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.895768] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.116385] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.116385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.116385] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.118823] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 253370fa-267b-40ea-a181-23b1092098fd with status ACTIVE [ 604.119079] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.119245] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.120455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.120455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.120455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.120455] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.120455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.120455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.120455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.120455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.120830] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.120927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.120927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.122238] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.122238] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.122238] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 253370fa-267b-40ea-a181-23b1092098fd is going to be updated. [ 604.142590] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.144857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.144857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.144857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.144857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.144857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-253370fa-267b-40ea-a181-23b1092098fd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.370209] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c053aa73-c45e-4ff7-9c78-5faef3e76294 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.370351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.370422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.370677] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.370841] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.370939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.371009] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.371186] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.371270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.371353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.371499] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c053aa73-c45e-4ff7-9c78-5faef3e76294 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.371587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.371639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.371806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.371962] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.372118] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.372160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.372269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.372340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.372417] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.372721] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c053aa73-c45e-4ff7-9c78-5faef3e76294',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.401851] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.402260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.402351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.402719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.402817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.403133] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.403222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.403256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.403420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.403540] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.403645] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc already deleted. [ 604.403731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.556869] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-768 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.556869] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.556869] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.557141] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.557483] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.557640] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.557731] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.558220] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.559562] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.559854] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.559966] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.560233] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.560233] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.560335] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.560432] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.562923] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.583431] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.584530] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 604.584530] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.584530] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.584530] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-8fef38a5-433b-408d-a74c-8ed8dd91681f taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.584760] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-8fef38a5-433b-408d-a74c-8ed8dd91681f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.584760] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-8fef38a5-433b-408d-a74c-8ed8dd91681f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.587699] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-8fef38a5-433b-408d-a74c-8ed8dd91681f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.589464] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fef38a5-433b-408d-a74c-8ed8dd91681f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.626453] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.870170] env[65359]: INFO networking_nsxv3.common.synchronization [req-1e4f35d9-0463-4047-af6a-4dd764ed40f3 req-99b99350-e96e-4226-b0c3-e004d491963d tempest-ServersNegativeTestMultiTenantJSON-938396851 tempest-ServersNegativeTestMultiTenantJSON-938396851-project-member] Enqueued Resource ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 with Priority: HIGHEST for action security_group_members [ 604.870170] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 with Priority: HIGHEST for action security_group_members [ 604.870170] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.870170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.870170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.872903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.873075] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.873803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.873803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.873803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.873803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.873803] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316dc9d7-17d3-414d-ba0c-8e1fd143cf19',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.875900] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c053aa73-c45e-4ff7-9c78-5faef3e76294: rpc.has_security_group_logging(os_id): False [ 604.894101] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.894396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.894396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.894564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.894638] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.894937] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.895085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.895085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.895317] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.895317] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.895488] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.895757] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.895757] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.895893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.895893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.896109] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.896235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.896335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.896432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.896500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.896559] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 is going to be created. [ 604.958289] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.958289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.958289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.958689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.958689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.973900] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 in Status: IN_PROGRESS for 2s [ 605.092647] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.092647] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.092647] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.092647] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.092887] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.092918] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 8fef38a5-433b-408d-a74c-8ed8dd91681f not found, creating... [ 605.093723] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.093723] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.093723] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.093723] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.093723] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.094054] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.094255] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.094255] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.094455] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.097515] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.097712] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 8fef38a5-433b-408d-a74c-8ed8dd91681f is going to be created. [ 605.118153] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.118473] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.118473] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.118756] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.118974] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.119208] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-8fef38a5-433b-408d-a74c-8ed8dd91681f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.126840] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.127026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.127117] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.127362] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.127449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.127579] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09044820-85da-426b-b103-26678a0652e6 is going to be created. [ 605.146786] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 in Status: SUCCESS [ 605.146786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.160271] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.160440] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.160515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.161020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.161132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.174963] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: UNINITIALIZED for 2s [ 605.238323] env[65359]: INFO networking_nsxv3.common.synchronization [None req-b0e11f20-c230-4541-8ac3-ca62ed4e3227 None None] Enqueued Resource ID: 95be86bb-ba8b-4e9d-9747-359440b91fe0 with Priority: HIGHEST for action port [ 605.238910] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95be86bb-ba8b-4e9d-9747-359440b91fe0 with Priority: HIGHEST for action port [ 605.239452] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-95be86bb-ba8b-4e9d-9747-359440b91fe0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.239452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95be86bb-ba8b-4e9d-9747-359440b91fe0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.239644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95be86bb-ba8b-4e9d-9747-359440b91fe0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.239841] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95be86bb-ba8b-4e9d-9747-359440b91fe0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.239929] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95be86bb-ba8b-4e9d-9747-359440b91fe0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.376930] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.376930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.376930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.377180] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.377220] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.377477] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.377592] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.377674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.377817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.377930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.377968] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 already deleted. [ 605.378058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.741747] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95be86bb-ba8b-4e9d-9747-359440b91fe0 [ 605.742299] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.742299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.742299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.742538] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.742538] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.742615] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95be86bb-ba8b-4e9d-9747-359440b91fe0 already deleted. [ 605.742686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95be86bb-ba8b-4e9d-9747-359440b91fe0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.841438] env[65359]: INFO networking_nsxv3.common.synchronization [req-49ce461e-3b56-491c-817d-6af2204590f7 req-58ef0e53-24e1-4cf6-96d9-6d62da18e797 service nova] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_rules [ 605.841606] env[65359]: INFO networking_nsxv3.common.synchronization [req-49ce461e-3b56-491c-817d-6af2204590f7 req-58ef0e53-24e1-4cf6-96d9-6d62da18e797 service nova] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 605.841743] env[65359]: INFO networking_nsxv3.common.synchronization [req-49ce461e-3b56-491c-817d-6af2204590f7 req-58ef0e53-24e1-4cf6-96d9-6d62da18e797 service nova] Enqueued Resource ID: 8fef38a5-433b-408d-a74c-8ed8dd91681f with Priority: HIGHEST for action port [ 605.842401] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_rules [ 605.842547] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 605.842654] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fef38a5-433b-408d-a74c-8ed8dd91681f with Priority: HIGHEST for action port [ 605.842932] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.843157] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.843214] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.843585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.843681] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.844537] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.844658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.844808] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.844997] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.845341] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.845341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.845341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.845483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.845514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.845601] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.851441] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fef38a5-433b-408d-a74c-8ed8dd91681f taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.851651] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fef38a5-433b-408d-a74c-8ed8dd91681f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.851651] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fef38a5-433b-408d-a74c-8ed8dd91681f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.852178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fef38a5-433b-408d-a74c-8ed8dd91681f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.852178] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fef38a5-433b-408d-a74c-8ed8dd91681f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.252613] env[65359]: INFO networking_nsxv3.common.synchronization [None req-b6d9b0d7-ed0c-4797-b0c0-dcaa09e33436 None None] Enqueued Resource ID: ede6518e-859d-421c-bfea-0de953a8426f with Priority: HIGHEST for action port [ 606.253443] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ede6518e-859d-421c-bfea-0de953a8426f with Priority: HIGHEST for action port [ 606.253576] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ede6518e-859d-421c-bfea-0de953a8426f taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.253698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ede6518e-859d-421c-bfea-0de953a8426f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.253772] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ede6518e-859d-421c-bfea-0de953a8426f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.255596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ede6518e-859d-421c-bfea-0de953a8426f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.255751] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ede6518e-859d-421c-bfea-0de953a8426f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.285297] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-559 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.285623] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-559" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.285742] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-559" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.286089] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-559" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.286355] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.286507] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.286617] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.286829] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.286968] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.287334] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 606.287334] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 606.287406] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 606.287500] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 606.287616] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 606.287715] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 606.287855] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 606.314614] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 606.314802] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 606.314893] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 606.315089] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-559" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.315413] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-23c3bc43-a417-4e4b-9722-599d3c0b5b5d taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.315579] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-23c3bc43-a417-4e4b-9722-599d3c0b5b5d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.315697] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-23c3bc43-a417-4e4b-9722-599d3c0b5b5d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.316059] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-23c3bc43-a417-4e4b-9722-599d3c0b5b5d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.316202] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23c3bc43-a417-4e4b-9722-599d3c0b5b5d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.353484] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.353691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.355182] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.355182] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8fef38a5-433b-408d-a74c-8ed8dd91681f with status ACTIVE [ 606.355182] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.355182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.355182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.355614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.355614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.355614] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.355614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.355744] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.355823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.355899] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.356094] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.356998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.356998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.356998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.356998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.356998] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8fef38a5-433b-408d-a74c-8ed8dd91681f is going to be updated. [ 606.386530] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.386712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.386785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.387008] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.387155] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.387316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fef38a5-433b-408d-a74c-8ed8dd91681f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.442846] env[65359]: INFO networking_nsxv3.common.synchronization [None req-5c715a91-a777-4430-b222-a495d6bd6c65 None None] Enqueued Resource ID: 21fbafcb-517e-4c48-b374-90d0ea04b4b9 with Priority: HIGHEST for action port [ 606.443631] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21fbafcb-517e-4c48-b374-90d0ea04b4b9 with Priority: HIGHEST for action port [ 606.444259] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-21fbafcb-517e-4c48-b374-90d0ea04b4b9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.444399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21fbafcb-517e-4c48-b374-90d0ea04b4b9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.444491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21fbafcb-517e-4c48-b374-90d0ea04b4b9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.444745] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21fbafcb-517e-4c48-b374-90d0ea04b4b9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.444820] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21fbafcb-517e-4c48-b374-90d0ea04b4b9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.758558] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ede6518e-859d-421c-bfea-0de953a8426f [ 606.758748] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.758889] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.758959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.759212] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.759307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.759401] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ede6518e-859d-421c-bfea-0de953a8426f already deleted. [ 606.759483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ede6518e-859d-421c-bfea-0de953a8426f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.818887] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.819138] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.819257] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.819590] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.819747] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.819900] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 23c3bc43-a417-4e4b-9722-599d3c0b5b5d not found, creating... [ 606.820172] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.820331] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.820440] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.820673] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.820798] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.821119] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.821270] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.821381] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.821619] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.821702] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.821836] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 23c3bc43-a417-4e4b-9722-599d3c0b5b5d is going to be created. [ 606.842181] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.842441] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.842622] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.842982] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.843124] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.843336] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-23c3bc43-a417-4e4b-9722-599d3c0b5b5d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.859738] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.947743] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21fbafcb-517e-4c48-b374-90d0ea04b4b9 [ 606.947992] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.948144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.948216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.948425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.948511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.948603] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21fbafcb-517e-4c48-b374-90d0ea04b4b9 already deleted. [ 606.948683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21fbafcb-517e-4c48-b374-90d0ea04b4b9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.993448] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 in Status: SUCCESS [ 606.994135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.188147] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: SUCCESS [ 607.188147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.188147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.188147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.188147] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.188679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.188679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.188679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.188679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.188679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.188826] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.363197] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.366170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.366170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.366170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.366170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.366170] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be created. [ 607.393471] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.393954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.394166] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.395027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.396019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.408703] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: UNINITIALIZED for 2s [ 607.462033] env[65359]: INFO networking_nsxv3.common.synchronization [None req-50686d53-db1d-4d50-8910-862224bc6dab None None] Enqueued Resource ID: 9023bbd6-2066-43cd-84f4-1d210a85fc62 with Priority: HIGHEST for action port [ 607.462665] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9023bbd6-2066-43cd-84f4-1d210a85fc62 with Priority: HIGHEST for action port [ 607.462996] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-9023bbd6-2066-43cd-84f4-1d210a85fc62 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.464801] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9023bbd6-2066-43cd-84f4-1d210a85fc62" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.464801] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9023bbd6-2066-43cd-84f4-1d210a85fc62" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.465016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9023bbd6-2066-43cd-84f4-1d210a85fc62" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.465016] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9023bbd6-2066-43cd-84f4-1d210a85fc62',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.600458] env[65359]: INFO networking_nsxv3.common.synchronization [req-1e4f35d9-0463-4047-af6a-4dd764ed40f3 req-564f6eee-465b-4895-873d-9d6a4a38cc09 service nova] Enqueued Resource ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 with Priority: HIGHEST for action security_group_rules [ 607.600458] env[65359]: INFO networking_nsxv3.common.synchronization [req-1e4f35d9-0463-4047-af6a-4dd764ed40f3 req-564f6eee-465b-4895-873d-9d6a4a38cc09 service nova] Enqueued Resource ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 with Priority: HIGHEST for action security_group_members [ 607.600458] env[65359]: INFO networking_nsxv3.common.synchronization [req-1e4f35d9-0463-4047-af6a-4dd764ed40f3 req-564f6eee-465b-4895-873d-9d6a4a38cc09 service nova] Enqueued Resource ID: 23c3bc43-a417-4e4b-9722-599d3c0b5b5d with Priority: HIGHEST for action port [ 607.600458] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 with Priority: HIGHEST for action security_group_rules [ 607.601036] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 with Priority: HIGHEST for action security_group_members [ 607.601036] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c3bc43-a417-4e4b-9722-599d3c0b5b5d with Priority: HIGHEST for action port [ 607.601879] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-316dc9d7-17d3-414d-ba0c-8e1fd143cf19 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.603123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.603123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.603123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.603123] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('316dc9d7-17d3-414d-ba0c-8e1fd143cf19',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.603422] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.603525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.603590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.603867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.604071] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.604245] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.604328] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.604531] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.605443] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.605443] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316dc9d7-17d3-414d-ba0c-8e1fd143cf19',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.606345] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-23c3bc43-a417-4e4b-9722-599d3c0b5b5d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.606345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23c3bc43-a417-4e4b-9722-599d3c0b5b5d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.606345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23c3bc43-a417-4e4b-9722-599d3c0b5b5d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.606345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23c3bc43-a417-4e4b-9722-599d3c0b5b5d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.606345] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23c3bc43-a417-4e4b-9722-599d3c0b5b5d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.694020] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.694277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.694388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.694672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.695641] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.695641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.695641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.695814] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.695928] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.696078] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.696260] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.696403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.696467] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.697218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.697218] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.697218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.697218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.697218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.697218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.697218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.697467] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.930623] env[65359]: INFO networking_nsxv3.common.synchronization [req-ef1bf4d2-61b4-4b8a-a747-c49ad4f1bf46 req-4a6f7aa2-02b4-4905-9035-6b35c434a4de tempest-ServerActionsTestJSON-975876043 tempest-ServerActionsTestJSON-975876043-project-member] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 607.931247] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 607.931621] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.931775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.931859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.932150] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.932327] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.932447] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.932523] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.932691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.932778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.932889] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.967165] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9023bbd6-2066-43cd-84f4-1d210a85fc62 [ 607.967408] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.967554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.967686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.968053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.968053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.968053] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9023bbd6-2066-43cd-84f4-1d210a85fc62 already deleted. [ 607.968248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9023bbd6-2066-43cd-84f4-1d210a85fc62" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.108559] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.108726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.108883] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('316dc9d7-17d3-414d-ba0c-8e1fd143cf19',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.110207] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23c3bc43-a417-4e4b-9722-599d3c0b5b5d with status ACTIVE [ 608.110382] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.110499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.110561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.110908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.110908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.111022] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.111123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.111234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.111394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.111394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.111537] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.111640] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.111687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.111820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.111927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.112024] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23c3bc43-a417-4e4b-9722-599d3c0b5b5d is going to be updated. [ 608.135407] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.136117] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.136117] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.136117] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.136117] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.136359] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23c3bc43-a417-4e4b-9722-599d3c0b5b5d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.199994] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 09044820-85da-426b-b103-26678a0652e6: rpc.has_security_group_logging(os_id): False [ 608.232178] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.232178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.232178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.232178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.232365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.232467] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.232539] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.232598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.232801] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.232874] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.233019] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.233117] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.233168] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.233342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.233415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.235524] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.235524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.235524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.235524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.235524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.235524] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09044820-85da-426b-b103-26678a0652e6 is going to be created. [ 608.305326] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.305326] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.305524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.307197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.307291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.318635] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: IN_PROGRESS for 2s [ 608.335761] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-227 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.336020] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.336178] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.337100] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.337449] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.337638] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.337772] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.338060] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.338238] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.338460] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.338588] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 608.338713] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 608.338985] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 608.338985] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.339100] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 608.339183] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 608.367646] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 608.368511] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 608.368511] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 608.368511] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.368622] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-d501cfc4-a86e-45ea-90e4-143a69c08ac3 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.368756] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-d501cfc4-a86e-45ea-90e4-143a69c08ac3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.368897] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-d501cfc4-a86e-45ea-90e4-143a69c08ac3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.369262] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-d501cfc4-a86e-45ea-90e4-143a69c08ac3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.369424] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d501cfc4-a86e-45ea-90e4-143a69c08ac3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.435201] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.435375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.435452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.435664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.435755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.435942] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.436046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.436114] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.436247] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.436320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.436400] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 already deleted. [ 608.436473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.615873] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('316dc9d7-17d3-414d-ba0c-8e1fd143cf19',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.873973] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.873973] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.873973] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.873973] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.873973] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.873973] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port d501cfc4-a86e-45ea-90e4-143a69c08ac3 not found, creating... [ 608.873973] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.874776] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.875947] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.875947] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.875947] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.875947] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.876732] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.876732] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.876732] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.876886] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.877070] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: d501cfc4-a86e-45ea-90e4-143a69c08ac3 is going to be created. [ 608.911867] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.912151] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.912281] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.912550] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.912779] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.913200] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-d501cfc4-a86e-45ea-90e4-143a69c08ac3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.118372] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.119344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.119344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.119344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.119344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.119344] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 is going to be created. [ 609.146452] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.146643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.146690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.146881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.147067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.158316] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 in Status: UNINITIALIZED for 2s [ 609.419423] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 609.419880] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.419941] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.420163] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.420358] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.420477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.420578] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.420724] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.420830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.420923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.421036] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.677180] env[65359]: INFO networking_nsxv3.common.synchronization [req-ef1bf4d2-61b4-4b8a-a747-c49ad4f1bf46 req-5801ef3e-42d1-4302-a308-5376ff2186c5 service nova] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_rules [ 609.677180] env[65359]: INFO networking_nsxv3.common.synchronization [req-ef1bf4d2-61b4-4b8a-a747-c49ad4f1bf46 req-5801ef3e-42d1-4302-a308-5376ff2186c5 service nova] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 609.677180] env[65359]: INFO networking_nsxv3.common.synchronization [req-ef1bf4d2-61b4-4b8a-a747-c49ad4f1bf46 req-5801ef3e-42d1-4302-a308-5376ff2186c5 service nova] Enqueued Resource ID: d501cfc4-a86e-45ea-90e4-143a69c08ac3 with Priority: HIGHEST for action port [ 609.677180] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_rules [ 609.677180] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 609.677431] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d501cfc4-a86e-45ea-90e4-143a69c08ac3 with Priority: HIGHEST for action port [ 609.677876] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.678336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.678492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.678791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.678989] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.680519] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.680789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.681104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.681401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.681712] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.681941] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.682125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.682376] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.682560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.682783] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.684037] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-d501cfc4-a86e-45ea-90e4-143a69c08ac3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.684357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d501cfc4-a86e-45ea-90e4-143a69c08ac3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.684532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d501cfc4-a86e-45ea-90e4-143a69c08ac3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.684921] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d501cfc4-a86e-45ea-90e4-143a69c08ac3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.685183] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d501cfc4-a86e-45ea-90e4-143a69c08ac3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.925275] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.925275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.925275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.925275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.925660] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.925660] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.925660] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.926254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.926254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.926415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.926504] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.926715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.926715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.926903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.927145] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.927145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.927145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.928255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.928255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.928255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.928255] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.188127] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.188379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.188810] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.189670] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d501cfc4-a86e-45ea-90e4-143a69c08ac3 with status ACTIVE [ 610.190255] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.190255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.190255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.190493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.190526] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.190906] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.190906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.190906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.191122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.191239] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.192441] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.192766] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.192821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.193767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.193767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.193767] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d501cfc4-a86e-45ea-90e4-143a69c08ac3 is going to be updated. [ 610.219500] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.219500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.219500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.219729] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.220013] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.220208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d501cfc4-a86e-45ea-90e4-143a69c08ac3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.351609] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: SUCCESS [ 610.352176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.434337] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6eb7ac19-945a-427f-84cb-cc4a488527fc: rpc.has_security_group_logging(os_id): False [ 610.651985] env[65359]: INFO networking_nsxv3.common.synchronization [None req-a03fad92-96df-4ad7-87df-bd6d07cfe75d None None] Enqueued Resource ID: a86d0ef3-fb3c-4776-9a45-aea5d7484eea with Priority: HIGHEST for action port [ 610.652585] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86d0ef3-fb3c-4776-9a45-aea5d7484eea with Priority: HIGHEST for action port [ 610.652937] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-a86d0ef3-fb3c-4776-9a45-aea5d7484eea taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.654310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a86d0ef3-fb3c-4776-9a45-aea5d7484eea" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.654310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a86d0ef3-fb3c-4776-9a45-aea5d7484eea" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.654310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a86d0ef3-fb3c-4776-9a45-aea5d7484eea" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.654310] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a86d0ef3-fb3c-4776-9a45-aea5d7484eea',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.667022] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.667022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.667022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.667294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.667548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.668054] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.668210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.668375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.668596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.669032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.669263] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.669922] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.670035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.670226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.670536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.670859] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.670998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.675034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.675034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.675034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.675034] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be created. [ 610.695969] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.758922] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.760208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.760466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.760811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.761059] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.777071] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 611.156783] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a86d0ef3-fb3c-4776-9a45-aea5d7484eea [ 611.157698] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.157698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.157698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.157934] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.157934] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.157998] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a86d0ef3-fb3c-4776-9a45-aea5d7484eea already deleted. [ 611.158051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a86d0ef3-fb3c-4776-9a45-aea5d7484eea" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.171352] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 in Status: SUCCESS [ 611.171352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.172077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.172077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.172077] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.172446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.172446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.172446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.172446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.172560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.172932] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('316dc9d7-17d3-414d-ba0c-8e1fd143cf19',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.198831] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.199044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.199145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.199356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.199448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.199553] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 is going to be created. [ 611.238565] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.238565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.238565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.238565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.238565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.251696] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: UNINITIALIZED for 2s [ 611.680035] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.680035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.680035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.680035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.681051] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.681051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.681051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.681051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.681051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.681051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.681051] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.681051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.681051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.681365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.681365] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.681431] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.681431] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.681600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.681671] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.681717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.681819] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('316dc9d7-17d3-414d-ba0c-8e1fd143cf19',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.823106] env[65359]: INFO networking_nsxv3.common.synchronization [req-0f989d6f-a078-4b80-b8b4-0bd36bd382fa req-cd1784be-7b86-4493-98da-957f17c6d4aa tempest-ServersAdminTestJSON-387763736 tempest-ServersAdminTestJSON-387763736-project-member] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 611.826385] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 611.826385] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.826385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.826385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.826385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.826385] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.826385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.826766] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.826766] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.826842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.826885] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.093574] env[65359]: INFO networking_nsxv3.common.synchronization [None req-6509e6b4-30e0-4f8b-8a54-5802fe03549c None None] Enqueued Resource ID: 7e420397-3864-4b13-ac13-d5253c6d5f5a with Priority: HIGHEST for action port [ 612.094210] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e420397-3864-4b13-ac13-d5253c6d5f5a with Priority: HIGHEST for action port [ 612.094828] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e420397-3864-4b13-ac13-d5253c6d5f5a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.094828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e420397-3864-4b13-ac13-d5253c6d5f5a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.094828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e420397-3864-4b13-ac13-d5253c6d5f5a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.095158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e420397-3864-4b13-ac13-d5253c6d5f5a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.096078] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e420397-3864-4b13-ac13-d5253c6d5f5a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.187061] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 316dc9d7-17d3-414d-ba0c-8e1fd143cf19: rpc.has_security_group_logging(os_id): False [ 612.207854] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.207854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.207854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.207854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.208174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.208174] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.208316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.208316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.208454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.208545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.208746] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.208832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.208893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.209052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.212063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.212063] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.212063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.212063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.212063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.212063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.212063] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 is going to be created. [ 612.278855] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.278855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.278855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.279063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.279548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.292952] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 in Status: IN_PROGRESS for 2s [ 612.330445] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.342554] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-768 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.342554] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.342554] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.342554] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.342798] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.342893] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.342996] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.343617] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.344285] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.344285] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.344285] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.344481] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.344481] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.345164] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.345323] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.345706] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.365810] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.366256] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.366256] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.366379] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.366586] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-017b45d9-d609-4060-98b4-5b330c6064e2 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.366737] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-017b45d9-d609-4060-98b4-5b330c6064e2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.366871] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-017b45d9-d609-4060-98b4-5b330c6064e2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.367195] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-017b45d9-d609-4060-98b4-5b330c6064e2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.367333] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('017b45d9-d609-4060-98b4-5b330c6064e2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.601680] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e420397-3864-4b13-ac13-d5253c6d5f5a [ 612.602081] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.602318] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.603874] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.604149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.604246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.604347] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e420397-3864-4b13-ac13-d5253c6d5f5a already deleted. [ 612.604428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e420397-3864-4b13-ac13-d5253c6d5f5a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.799143] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 612.799143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.833472] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.870382] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.870597] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.870721] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.871556] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.871556] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.871556] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 017b45d9-d609-4060-98b4-5b330c6064e2 not found, creating... [ 612.871556] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.871808] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.871808] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.873433] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.873433] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.873963] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.873963] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.873963] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.874502] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.874922] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.874922] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 017b45d9-d609-4060-98b4-5b330c6064e2 is going to be created. [ 612.887946] env[65359]: INFO networking_nsxv3.common.synchronization [None req-46b44779-a625-4761-85be-35e497af8f2a None None] Enqueued Resource ID: b61284a8-0a4c-40ec-8cbc-73ad299bff5d with Priority: HIGHEST for action port [ 612.887946] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b61284a8-0a4c-40ec-8cbc-73ad299bff5d with Priority: HIGHEST for action port [ 612.887946] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-b61284a8-0a4c-40ec-8cbc-73ad299bff5d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.887946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b61284a8-0a4c-40ec-8cbc-73ad299bff5d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.887946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b61284a8-0a4c-40ec-8cbc-73ad299bff5d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.887946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b61284a8-0a4c-40ec-8cbc-73ad299bff5d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.887946] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b61284a8-0a4c-40ec-8cbc-73ad299bff5d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.896090] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.896341] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.896921] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.896921] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.897030] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.897160] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-017b45d9-d609-4060-98b4-5b330c6064e2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.035843] env[65359]: INFO networking_nsxv3.common.synchronization [None req-d2b1fc51-25e3-46b8-a168-2aecdf3b1ba1 None None] Enqueued Resource ID: 0e25bc4d-06c9-49f1-9ffa-3de7d6308f9e with Priority: HIGHEST for action port [ 613.035843] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e25bc4d-06c9-49f1-9ffa-3de7d6308f9e with Priority: HIGHEST for action port [ 613.035843] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e25bc4d-06c9-49f1-9ffa-3de7d6308f9e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.035843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e25bc4d-06c9-49f1-9ffa-3de7d6308f9e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.035843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e25bc4d-06c9-49f1-9ffa-3de7d6308f9e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.037859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e25bc4d-06c9-49f1-9ffa-3de7d6308f9e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.037996] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e25bc4d-06c9-49f1-9ffa-3de7d6308f9e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.263432] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: SUCCESS [ 613.263682] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.263920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.264208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.264425] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.264537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.265202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.265202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.265202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.265202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.265469] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.335371] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.337086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.337086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.337086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.337086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.337086] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be updated. [ 613.380622] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.380896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.380999] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.381280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.381502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.390426] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b61284a8-0a4c-40ec-8cbc-73ad299bff5d [ 613.390426] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.390426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.390426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.390426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.390774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.390774] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b61284a8-0a4c-40ec-8cbc-73ad299bff5d already deleted. [ 613.390774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b61284a8-0a4c-40ec-8cbc-73ad299bff5d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.398286] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 613.540029] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e25bc4d-06c9-49f1-9ffa-3de7d6308f9e [ 613.540400] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.540530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.540530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.541652] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.541652] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.541652] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e25bc4d-06c9-49f1-9ffa-3de7d6308f9e already deleted. [ 613.541652] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e25bc4d-06c9-49f1-9ffa-3de7d6308f9e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.648083] env[65359]: INFO networking_nsxv3.common.synchronization [req-0f989d6f-a078-4b80-b8b4-0bd36bd382fa req-85728b1d-4cb5-4cf3-82ca-7fb057db4484 service nova] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_rules [ 613.648196] env[65359]: INFO networking_nsxv3.common.synchronization [req-0f989d6f-a078-4b80-b8b4-0bd36bd382fa req-85728b1d-4cb5-4cf3-82ca-7fb057db4484 service nova] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 613.648457] env[65359]: INFO networking_nsxv3.common.synchronization [req-0f989d6f-a078-4b80-b8b4-0bd36bd382fa req-85728b1d-4cb5-4cf3-82ca-7fb057db4484 service nova] Enqueued Resource ID: 017b45d9-d609-4060-98b4-5b330c6064e2 with Priority: HIGHEST for action port [ 613.650418] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_rules [ 613.650537] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 613.650648] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 017b45d9-d609-4060-98b4-5b330c6064e2 with Priority: HIGHEST for action port [ 613.651235] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.651235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.651235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.651547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.651547] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.652516] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.652639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.652904] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-017b45d9-d609-4060-98b4-5b330c6064e2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.653059] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-017b45d9-d609-4060-98b4-5b330c6064e2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.653910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-017b45d9-d609-4060-98b4-5b330c6064e2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.654144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-017b45d9-d609-4060-98b4-5b330c6064e2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.654229] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('017b45d9-d609-4060-98b4-5b330c6064e2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.767791] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.157599] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.157599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.157599] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 017b45d9-d609-4060-98b4-5b330c6064e2 with status ACTIVE [ 614.157599] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.157599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.157599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.157599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.157599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.158339] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.158339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.158339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.161049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.161049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.161049] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.161049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.161049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.161049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.161049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.161049] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 017b45d9-d609-4060-98b4-5b330c6064e2 is going to be updated. [ 614.190717] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.190717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.190717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.190717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.190717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.190717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-017b45d9-d609-4060-98b4-5b330c6064e2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.277401] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3577cfc-adec-4c56-bc24-6acdb8887663: rpc.has_security_group_logging(os_id): False [ 614.308585] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.308788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.308842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.309114] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.309248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.309519] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.309656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.309711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.309883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.309964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.310069] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 is going to be created. [ 614.312807] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 in Status: SUCCESS [ 614.313046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.399368] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.399513] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.399570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.400121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.400121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.414140] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: IN_PROGRESS for 2s [ 615.271189] env[65359]: INFO networking_nsxv3.common.synchronization [req-720590a2-67ea-4b7f-8ec4-b48293b49bdc req-4f6921d8-884e-4899-98ab-1758e6f97273 tempest-InstanceActionsTestJSON-1555854732 tempest-InstanceActionsTestJSON-1555854732-project-member] Enqueued Resource ID: 78b29888-5f88-401c-8a70-59d4c410c80d with Priority: HIGHEST for action security_group_members [ 615.271757] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b29888-5f88-401c-8a70-59d4c410c80d with Priority: HIGHEST for action security_group_members [ 615.273259] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b29888-5f88-401c-8a70-59d4c410c80d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.273259] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.273400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.273729] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.273913] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.274029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.274097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.274250] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.274343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.274438] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b29888-5f88-401c-8a70-59d4c410c80d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.409677] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 615.409677] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.409849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.410146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.410235] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.410379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.410379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.410510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.410602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.410731] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.780262] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.780516] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.780552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.780796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.780915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.781200] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.781349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.781423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.781625] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.781768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.781874] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b29888-5f88-401c-8a70-59d4c410c80d already deleted. [ 615.781993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.808887] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.809733] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-122" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.809733] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-122" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.809902] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-122" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.810171] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.811025] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.811025] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.811025] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.811025] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.811251] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.811401] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.811563] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.811728] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.811904] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.812104] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.812253] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.835876] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.836333] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.836333] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.836543] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-122" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.836702] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-ffe89262-029b-429d-a6d1-9e29c839eb22 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.836898] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-ffe89262-029b-429d-a6d1-9e29c839eb22" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.837538] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-ffe89262-029b-429d-a6d1-9e29c839eb22" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.837538] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-ffe89262-029b-429d-a6d1-9e29c839eb22" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.837538] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffe89262-029b-429d-a6d1-9e29c839eb22',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.912937] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.342238] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.342238] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.342238] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.342238] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.343100] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.343100] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port ffe89262-029b-429d-a6d1-9e29c839eb22 not found, creating... [ 616.343100] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.343297] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.343356] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.344894] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.344894] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.344894] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.344894] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.344894] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.344894] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.345628] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.345628] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: ffe89262-029b-429d-a6d1-9e29c839eb22 is going to be created. [ 616.400969] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.401368] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.401624] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.402141] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.402417] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.402792] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-ffe89262-029b-429d-a6d1-9e29c839eb22" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.417183] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.444574] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: SUCCESS [ 616.444873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.919492] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.919751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.919849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.920113] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.920204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.920291] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be updated. [ 616.955884] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.956164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.956211] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.956480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.956712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.969636] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 617.154482] env[65359]: INFO networking_nsxv3.common.synchronization [req-720590a2-67ea-4b7f-8ec4-b48293b49bdc req-c75767fe-a2c0-493c-a776-0eb1c903dbc2 service nova] Enqueued Resource ID: 78b29888-5f88-401c-8a70-59d4c410c80d with Priority: HIGHEST for action security_group_rules [ 617.154482] env[65359]: INFO networking_nsxv3.common.synchronization [req-720590a2-67ea-4b7f-8ec4-b48293b49bdc req-c75767fe-a2c0-493c-a776-0eb1c903dbc2 service nova] Enqueued Resource ID: 78b29888-5f88-401c-8a70-59d4c410c80d with Priority: HIGHEST for action security_group_members [ 617.154482] env[65359]: INFO networking_nsxv3.common.synchronization [req-720590a2-67ea-4b7f-8ec4-b48293b49bdc req-c75767fe-a2c0-493c-a776-0eb1c903dbc2 service nova] Enqueued Resource ID: ffe89262-029b-429d-a6d1-9e29c839eb22 with Priority: HIGHEST for action port [ 617.154482] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b29888-5f88-401c-8a70-59d4c410c80d with Priority: HIGHEST for action security_group_rules [ 617.154482] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b29888-5f88-401c-8a70-59d4c410c80d with Priority: HIGHEST for action security_group_members [ 617.154772] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe89262-029b-429d-a6d1-9e29c839eb22 with Priority: HIGHEST for action port [ 617.155211] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b29888-5f88-401c-8a70-59d4c410c80d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.155635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.155843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.156229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.156456] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b29888-5f88-401c-8a70-59d4c410c80d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.157704] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b29888-5f88-401c-8a70-59d4c410c80d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.157949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.158767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.159111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.160788] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.164807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.164807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.164807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.164807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.164807] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b29888-5f88-401c-8a70-59d4c410c80d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.164807] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffe89262-029b-429d-a6d1-9e29c839eb22 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.164807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffe89262-029b-429d-a6d1-9e29c839eb22" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.164807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffe89262-029b-429d-a6d1-9e29c839eb22" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.164807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffe89262-029b-429d-a6d1-9e29c839eb22" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.164807] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffe89262-029b-429d-a6d1-9e29c839eb22',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.600429] env[65359]: INFO networking_nsxv3.common.synchronization [None req-b1a09b3a-d0ae-4f64-83bc-1df5e116453b None None] Enqueued Resource ID: 943af8ce-e40a-46c0-94de-db3835d083ec with Priority: HIGHEST for action port [ 617.601634] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943af8ce-e40a-46c0-94de-db3835d083ec with Priority: HIGHEST for action port [ 617.602052] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-943af8ce-e40a-46c0-94de-db3835d083ec taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.602223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-943af8ce-e40a-46c0-94de-db3835d083ec" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.602686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-943af8ce-e40a-46c0-94de-db3835d083ec" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.603209] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-943af8ce-e40a-46c0-94de-db3835d083ec" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.603318] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('943af8ce-e40a-46c0-94de-db3835d083ec',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.664962] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b29888-5f88-401c-8a70-59d4c410c80d taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.664962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.670426] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffe89262-029b-429d-a6d1-9e29c839eb22 with status ACTIVE [ 617.670883] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.670883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.670883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.671094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.671194] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.671369] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.671476] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.671537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.671692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.671771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.672058] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.672058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.672174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.672260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.672331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.672413] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffe89262-029b-429d-a6d1-9e29c839eb22 is going to be updated. [ 617.675620] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78b29888-5f88-401c-8a70-59d4c410c80d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.709406] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.709406] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.710405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.710405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.710405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.710405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffe89262-029b-429d-a6d1-9e29c839eb22" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.763197] env[65359]: INFO networking_nsxv3.common.synchronization [req-a09917da-318b-4d85-b629-b59b90697df9 req-96af368b-e680-41e0-b512-e9cd52a9bf5b tempest-InstanceActionsNegativeTestJSON-190275811 tempest-InstanceActionsNegativeTestJSON-190275811-project-member] Enqueued Resource ID: db2b8872-8032-4084-b9ac-eddda23d1176 with Priority: HIGHEST for action security_group_members [ 617.764691] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2b8872-8032-4084-b9ac-eddda23d1176 with Priority: HIGHEST for action security_group_members [ 617.765182] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2b8872-8032-4084-b9ac-eddda23d1176 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.765927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.765927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.766427] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.766549] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.767068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.767068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.770665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.770665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.770817] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db2b8872-8032-4084-b9ac-eddda23d1176',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.108121] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 943af8ce-e40a-46c0-94de-db3835d083ec [ 618.108121] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.108121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.108121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.108121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.108121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.108121] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:943af8ce-e40a-46c0-94de-db3835d083ec already deleted. [ 618.108121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-943af8ce-e40a-46c0-94de-db3835d083ec" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.179721] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78b29888-5f88-401c-8a70-59d4c410c80d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.275777] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.275777] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.275777] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.275777] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.275777] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.276162] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.276162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.276249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.276394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.276502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.276555] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db2b8872-8032-4084-b9ac-eddda23d1176 already deleted. [ 618.276641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.428360] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-104 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.428360] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-104" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.428360] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-104" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.428360] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-104" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.428360] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.428360] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.428360] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.428873] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.429184] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.429518] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.429843] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.430099] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.430345] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.430610] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.432580] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.432580] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.454124] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.454124] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 618.454124] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.454124] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-104" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.454124] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-57a62c65-4ac6-4b68-9e18-028245e585b2 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.454124] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-57a62c65-4ac6-4b68-9e18-028245e585b2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.454124] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-57a62c65-4ac6-4b68-9e18-028245e585b2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.454124] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-57a62c65-4ac6-4b68-9e18-028245e585b2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.454124] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57a62c65-4ac6-4b68-9e18-028245e585b2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.683961] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.684320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.684320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.684483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.684582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.684684] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b29888-5f88-401c-8a70-59d4c410c80d is going to be created. [ 618.737245] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.737482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.737482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.737738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.737887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.754954] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b29888-5f88-401c-8a70-59d4c410c80d in Status: UNINITIALIZED for 2s [ 618.960341] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.960341] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.960341] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.960341] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.960341] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.960341] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 57a62c65-4ac6-4b68-9e18-028245e585b2 not found, creating... [ 618.960341] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.960748] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.960748] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.960898] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.961038] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.961349] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.961520] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.965022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.965022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.965022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.965022] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 57a62c65-4ac6-4b68-9e18-028245e585b2 is going to be created. [ 618.985184] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 618.985339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.985493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.986179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.986179] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.986179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.986179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.986416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.986416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.986416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.986541] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.991580] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.991580] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.991580] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.991780] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.994041] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.994041] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-57a62c65-4ac6-4b68-9e18-028245e585b2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.492027] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.492027] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.492027] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.492027] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.492705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.492705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.492705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.492705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.492705] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.814300] env[65359]: INFO networking_nsxv3.common.synchronization [req-a09917da-318b-4d85-b629-b59b90697df9 req-ac5281f6-0338-4f73-a1f2-c04a3b051bb5 service nova] Enqueued Resource ID: db2b8872-8032-4084-b9ac-eddda23d1176 with Priority: HIGHEST for action security_group_rules [ 619.814300] env[65359]: INFO networking_nsxv3.common.synchronization [req-a09917da-318b-4d85-b629-b59b90697df9 req-ac5281f6-0338-4f73-a1f2-c04a3b051bb5 service nova] Enqueued Resource ID: db2b8872-8032-4084-b9ac-eddda23d1176 with Priority: HIGHEST for action security_group_members [ 619.814300] env[65359]: INFO networking_nsxv3.common.synchronization [req-a09917da-318b-4d85-b629-b59b90697df9 req-ac5281f6-0338-4f73-a1f2-c04a3b051bb5 service nova] Enqueued Resource ID: 57a62c65-4ac6-4b68-9e18-028245e585b2 with Priority: HIGHEST for action port [ 619.814300] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2b8872-8032-4084-b9ac-eddda23d1176 with Priority: HIGHEST for action security_group_rules [ 619.814300] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2b8872-8032-4084-b9ac-eddda23d1176 with Priority: HIGHEST for action security_group_members [ 619.814300] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57a62c65-4ac6-4b68-9e18-028245e585b2 with Priority: HIGHEST for action port [ 619.820794] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db2b8872-8032-4084-b9ac-eddda23d1176 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.820794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.820794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.820794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.820794] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db2b8872-8032-4084-b9ac-eddda23d1176',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.822646] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2b8872-8032-4084-b9ac-eddda23d1176 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.822646] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.822794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.823111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.823386] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.823606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.823751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.824012] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.824250] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.825185] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db2b8872-8032-4084-b9ac-eddda23d1176',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.827235] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-57a62c65-4ac6-4b68-9e18-028245e585b2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.827654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57a62c65-4ac6-4b68-9e18-028245e585b2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.827813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57a62c65-4ac6-4b68-9e18-028245e585b2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.828429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57a62c65-4ac6-4b68-9e18-028245e585b2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.828429] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57a62c65-4ac6-4b68-9e18-028245e585b2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.997093] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6eb7ac19-945a-427f-84cb-cc4a488527fc: rpc.has_security_group_logging(os_id): False [ 620.020107] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.020107] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.020107] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.020411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.020608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.020988] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.021127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.021127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.021426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.021426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.021800] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.021800] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.021995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.021995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.024169] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.025072] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.025072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.025072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.025441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.025539] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.025700] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be updated. [ 620.100159] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.100797] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.100797] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.102291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.102291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.119305] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 620.161182] env[65359]: INFO networking_nsxv3.common.synchronization [None req-db07cce0-13ca-4d81-a8fd-2823af744b83 None None] Enqueued Resource ID: 6cff88de-73b2-4fcb-9288-21a615d97413 with Priority: HIGHEST for action port [ 620.161679] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cff88de-73b2-4fcb-9288-21a615d97413 with Priority: HIGHEST for action port [ 620.161679] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cff88de-73b2-4fcb-9288-21a615d97413 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.161887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cff88de-73b2-4fcb-9288-21a615d97413" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.161887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cff88de-73b2-4fcb-9288-21a615d97413" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.166073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cff88de-73b2-4fcb-9288-21a615d97413" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.166245] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cff88de-73b2-4fcb-9288-21a615d97413',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.323417] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2b8872-8032-4084-b9ac-eddda23d1176 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.323417] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.331049] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db2b8872-8032-4084-b9ac-eddda23d1176',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.334978] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57a62c65-4ac6-4b68-9e18-028245e585b2 with status ACTIVE [ 620.334978] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.334978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.334978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.334978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.334978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.335381] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.335494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.335571] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.335762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.335907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.339375] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.339545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.339669] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.340164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.340164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.340164] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57a62c65-4ac6-4b68-9e18-028245e585b2 is going to be updated. [ 620.366999] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.367202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.367254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.367496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.367638] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.367826] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57a62c65-4ac6-4b68-9e18-028245e585b2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.484038] env[65359]: INFO networking_nsxv3.common.synchronization [req-4ba932ba-c06b-446d-a843-6b49b1541568 req-151efff3-3efa-4d73-9044-c5c45e35fadc tempest-VolumesAssistedSnapshotsTest-1704132221 tempest-VolumesAssistedSnapshotsTest-1704132221-project-member] Enqueued Resource ID: 505f1bca-748c-4f56-9f01-2a595d335a84 with Priority: HIGHEST for action security_group_members [ 620.484782] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505f1bca-748c-4f56-9f01-2a595d335a84 with Priority: HIGHEST for action security_group_members [ 620.486041] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-505f1bca-748c-4f56-9f01-2a595d335a84 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.486041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.486041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.486327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.486566] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.486701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.487026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.487279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.487395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.487554] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('505f1bca-748c-4f56-9f01-2a595d335a84',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.668556] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cff88de-73b2-4fcb-9288-21a615d97413 [ 620.668978] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.669386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.669561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.669761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.669883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.670016] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cff88de-73b2-4fcb-9288-21a615d97413 already deleted. [ 620.670130] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cff88de-73b2-4fcb-9288-21a615d97413" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.769919] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b29888-5f88-401c-8a70-59d4c410c80d in Status: SUCCESS [ 620.770067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.770611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.770951] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.771165] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.771754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.771754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.771754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.771754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.771754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.771973] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78b29888-5f88-401c-8a70-59d4c410c80d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.835150] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db2b8872-8032-4084-b9ac-eddda23d1176',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.867148] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.868690] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-606" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.868690] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-606" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.868690] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-606" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.868690] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.868690] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.868690] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.868690] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.868690] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.868980] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.868980] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.869315] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.869315] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.869315] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.869434] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.869591] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.889284] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.889618] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 620.889618] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.889851] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-606" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.890282] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-adaeead5-3674-4215-87bd-aaed0b7b7509 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.890535] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-adaeead5-3674-4215-87bd-aaed0b7b7509" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.890672] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-adaeead5-3674-4215-87bd-aaed0b7b7509" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.891071] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-adaeead5-3674-4215-87bd-aaed0b7b7509" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.891213] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adaeead5-3674-4215-87bd-aaed0b7b7509',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.990405] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.990630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.990630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.990934] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.991048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.991252] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.991369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.991515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.991595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.991671] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.991757] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 505f1bca-748c-4f56-9f01-2a595d335a84 already deleted. [ 620.991840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.284182] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b29888-5f88-401c-8a70-59d4c410c80d taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.284182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.284182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.284182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.284182] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.284182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.284182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.284182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.284182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.284182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.284182] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b29888-5f88-401c-8a70-59d4c410c80d taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.284182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.284182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.284182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.284182] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.284182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.285049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.285049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.285049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.285049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.287134] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78b29888-5f88-401c-8a70-59d4c410c80d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.342024] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.342024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.342024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.342024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.342024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.342024] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db2b8872-8032-4084-b9ac-eddda23d1176 is going to be created. [ 621.377910] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.378218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.378293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.378508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.378677] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.393832] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.394160] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.394525] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.394525] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.394651] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.394748] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port adaeead5-3674-4215-87bd-aaed0b7b7509 not found, creating... [ 621.395040] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.395299] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.395468] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.395707] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.395839] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.396234] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.396397] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.396505] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.396738] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.396907] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.397108] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: adaeead5-3674-4215-87bd-aaed0b7b7509 is going to be created. [ 621.399124] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2b8872-8032-4084-b9ac-eddda23d1176 in Status: UNINITIALIZED for 2s [ 621.434327] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.434682] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.434790] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.435213] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.435448] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.435691] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-adaeead5-3674-4215-87bd-aaed0b7b7509" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.563053] env[65359]: INFO networking_nsxv3.common.synchronization [req-fe622dff-1b2f-4b70-a597-14edf92d5a9e req-0a94798d-3265-4e52-ad16-c8df101d110a tempest-DeleteServersAdminTestJSON-620369160 tempest-DeleteServersAdminTestJSON-620369160-project-admin] Enqueued Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_members [ 621.563053] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_members [ 621.563549] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c01e6ff-b831-4d21-8c9a-e3a067190d76 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.563697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.563768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.563996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.564253] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.564424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.564424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.564559] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.564693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.564795] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.792188] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78b29888-5f88-401c-8a70-59d4c410c80d: rpc.has_security_group_logging(os_id): False [ 621.816968] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.817171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.817243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.817462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.817563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.817767] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.817858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.817924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.818088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.818173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.818334] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.818424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.818537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.818603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.818669] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.818857] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.818964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.819125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.819841] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.819841] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.820078] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b29888-5f88-401c-8a70-59d4c410c80d is going to be created. [ 621.885104] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.885597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.885597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.885597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.885845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.897483] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b29888-5f88-401c-8a70-59d4c410c80d in Status: IN_PROGRESS for 2s [ 622.067404] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.067609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.067654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.067937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.068101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.068411] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.068561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.068726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.068896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.068980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.069094] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 is going to be updated. [ 622.104454] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.104778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.104778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.104953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.105094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.114883] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 in Status: IN_PROGRESS for 2s [ 622.136148] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 622.136424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.171934] env[65359]: INFO networking_nsxv3.common.synchronization [req-4ba932ba-c06b-446d-a843-6b49b1541568 req-f219016c-5153-4b06-a86d-335f6c151f2b service nova] Enqueued Resource ID: 505f1bca-748c-4f56-9f01-2a595d335a84 with Priority: HIGHEST for action security_group_rules [ 622.172130] env[65359]: INFO networking_nsxv3.common.synchronization [req-4ba932ba-c06b-446d-a843-6b49b1541568 req-f219016c-5153-4b06-a86d-335f6c151f2b service nova] Enqueued Resource ID: 505f1bca-748c-4f56-9f01-2a595d335a84 with Priority: HIGHEST for action security_group_members [ 622.172251] env[65359]: INFO networking_nsxv3.common.synchronization [req-4ba932ba-c06b-446d-a843-6b49b1541568 req-f219016c-5153-4b06-a86d-335f6c151f2b service nova] Enqueued Resource ID: adaeead5-3674-4215-87bd-aaed0b7b7509 with Priority: HIGHEST for action port [ 622.172730] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505f1bca-748c-4f56-9f01-2a595d335a84 with Priority: HIGHEST for action security_group_rules [ 622.173431] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505f1bca-748c-4f56-9f01-2a595d335a84 with Priority: HIGHEST for action security_group_members [ 622.173431] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaeead5-3674-4215-87bd-aaed0b7b7509 with Priority: HIGHEST for action port [ 622.173567] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-505f1bca-748c-4f56-9f01-2a595d335a84 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.173707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.173769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.173994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.174098] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('505f1bca-748c-4f56-9f01-2a595d335a84',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.175518] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-505f1bca-748c-4f56-9f01-2a595d335a84 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.175745] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.175831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.176046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.176208] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.176314] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.176378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.176548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.176626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.176758] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('505f1bca-748c-4f56-9f01-2a595d335a84',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.178331] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-adaeead5-3674-4215-87bd-aaed0b7b7509 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.179126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adaeead5-3674-4215-87bd-aaed0b7b7509" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.179252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adaeead5-3674-4215-87bd-aaed0b7b7509" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.179571] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adaeead5-3674-4215-87bd-aaed0b7b7509" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.179657] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adaeead5-3674-4215-87bd-aaed0b7b7509',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.677194] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-505f1bca-748c-4f56-9f01-2a595d335a84 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.677422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.678929] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('505f1bca-748c-4f56-9f01-2a595d335a84',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.683394] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adaeead5-3674-4215-87bd-aaed0b7b7509 with status ACTIVE [ 622.684592] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.685083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.685175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.685497] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.685562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.685780] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.685922] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.686018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.686242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.686853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.687242] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.687390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.687483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.687714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.687816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.687908] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adaeead5-3674-4215-87bd-aaed0b7b7509 is going to be updated. [ 622.713971] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.714174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.714174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.714347] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.714509] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.714687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adaeead5-3674-4215-87bd-aaed0b7b7509" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.917729] env[65359]: INFO networking_nsxv3.common.synchronization [req-a15bb97a-3a75-47fc-9822-cd7e18d0038a req-6b4e9260-bf86-411d-93b5-f4c2dfc6505d tempest-ImagesNegativeTestJSON-1903506191 tempest-ImagesNegativeTestJSON-1903506191-project-member] Enqueued Resource ID: 7565297c-f219-4968-8aee-c13251599a0c with Priority: HIGHEST for action security_group_members [ 622.918394] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7565297c-f219-4968-8aee-c13251599a0c with Priority: HIGHEST for action security_group_members [ 622.918720] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-7565297c-f219-4968-8aee-c13251599a0c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.918832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.918908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.921036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.921036] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.921036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.921036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.921036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.921036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.921036] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7565297c-f219-4968-8aee-c13251599a0c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.060615] env[65359]: INFO networking_nsxv3.common.synchronization [None req-1f945fa8-3b29-415f-a452-148461ff5a8e tempest-ServersWithSpecificFlavorTestJSON-1171930916 tempest-ServersWithSpecificFlavorTestJSON-1171930916-project-member] Enqueued Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_rules [ 623.061689] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_rules [ 623.061689] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.062190] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.062190] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.062282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.062383] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.184312] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('505f1bca-748c-4f56-9f01-2a595d335a84',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.418091] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2b8872-8032-4084-b9ac-eddda23d1176 in Status: SUCCESS [ 623.418558] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.418657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.418878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.419183] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.419286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.419496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.420039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.420039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.420039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.420039] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db2b8872-8032-4084-b9ac-eddda23d1176',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.423791] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.424286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.424286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.426378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.426378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.426378] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.426378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.426378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.426378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.426378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.426378] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7565297c-f219-4968-8aee-c13251599a0c already deleted. [ 623.426378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.508302] env[65359]: INFO networking_nsxv3.common.synchronization [None req-045a9337-48be-40fe-8d75-c1e7b4acea95 tempest-ServersWithSpecificFlavorTestJSON-1171930916 tempest-ServersWithSpecificFlavorTestJSON-1171930916-project-member] Enqueued Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_rules [ 623.508972] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_rules [ 623.509613] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.509789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.534743] env[65359]: INFO networking_nsxv3.common.synchronization [None req-19d17b93-ebf3-4438-baa1-981d1a944059 None None] Enqueued Resource ID: 26a1b812-5ac4-42a3-83fe-a567d919748d with Priority: HIGHEST for action port [ 623.535781] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26a1b812-5ac4-42a3-83fe-a567d919748d with Priority: HIGHEST for action port [ 623.536248] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-26a1b812-5ac4-42a3-83fe-a567d919748d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.536581] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26a1b812-5ac4-42a3-83fe-a567d919748d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.536749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26a1b812-5ac4-42a3-83fe-a567d919748d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.540178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26a1b812-5ac4-42a3-83fe-a567d919748d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.540178] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26a1b812-5ac4-42a3-83fe-a567d919748d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.585325] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.587193] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.587193] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.588375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.588375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.588375] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 already deleted. [ 623.588375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.588375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.588375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.588375] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.673712] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-429 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.674257] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-429" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.674447] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-429" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.674852] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-429" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.675431] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.675718] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.675936] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.676224] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.676378] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.676591] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.677197] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.677197] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.677197] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.677197] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.677197] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.677444] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.688809] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.688991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.688991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.689237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.689464] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.689545] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 505f1bca-748c-4f56-9f01-2a595d335a84 is going to be created. [ 623.703344] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.703497] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.703657] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.703749] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-429" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.704093] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-457b4791-1703-4ed7-9eec-af190f17a341 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.704378] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-457b4791-1703-4ed7-9eec-af190f17a341" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.705322] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-457b4791-1703-4ed7-9eec-af190f17a341" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.705322] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-457b4791-1703-4ed7-9eec-af190f17a341" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.705322] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('457b4791-1703-4ed7-9eec-af190f17a341',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.718413] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.718413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.718413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.718413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.718711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.732026] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 505f1bca-748c-4f56-9f01-2a595d335a84 in Status: UNINITIALIZED for 2s [ 623.911127] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b29888-5f88-401c-8a70-59d4c410c80d in Status: SUCCESS [ 623.911127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.923418] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2b8872-8032-4084-b9ac-eddda23d1176 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.923692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.923692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.923865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.923976] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.924098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.924162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.924389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.924473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.924564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.924713] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2b8872-8032-4084-b9ac-eddda23d1176 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.924813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.924916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.925011] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.925161] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.925253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.925315] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.925452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.925527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.925605] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.925693] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db2b8872-8032-4084-b9ac-eddda23d1176',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.040120] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26a1b812-5ac4-42a3-83fe-a567d919748d [ 624.043603] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.043796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.043877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.044108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.044217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.044301] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26a1b812-5ac4-42a3-83fe-a567d919748d already deleted. [ 624.044378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26a1b812-5ac4-42a3-83fe-a567d919748d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.113956] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.113956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.113956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.113956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.113956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.113956] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 already deleted. [ 624.113956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.126491] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 in Status: SUCCESS [ 624.126777] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 deletion is rescheduled due to dependency. [ 624.126953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.207968] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.208218] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.208347] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.208626] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.208774] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.208920] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 457b4791-1703-4ed7-9eec-af190f17a341 not found, creating... [ 624.209198] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.209395] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.209548] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.210084] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.210084] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.210620] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.210791] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.210911] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.211137] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.211742] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.211742] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 457b4791-1703-4ed7-9eec-af190f17a341 is going to be created. [ 624.235559] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.237708] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.237708] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.237708] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.237708] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.237708] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-457b4791-1703-4ed7-9eec-af190f17a341" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.432887] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db2b8872-8032-4084-b9ac-eddda23d1176: rpc.has_security_group_logging(os_id): False [ 624.455044] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.455332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.455332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.455445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.456739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.456739] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.456739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.456739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.456739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.456739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.456739] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.456739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.456739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.456739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.456739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.457341] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.457341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.457341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.457341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.457341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.457341] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db2b8872-8032-4084-b9ac-eddda23d1176 is going to be created. [ 624.549473] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.549653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.549709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.550073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.550278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.562992] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db2b8872-8032-4084-b9ac-eddda23d1176 in Status: IN_PROGRESS for 2s [ 624.968088] env[65359]: INFO networking_nsxv3.common.synchronization [req-a15bb97a-3a75-47fc-9822-cd7e18d0038a req-8027b2fa-72da-4ac1-bc51-903e0fe7bbbc service nova] Enqueued Resource ID: 7565297c-f219-4968-8aee-c13251599a0c with Priority: HIGHEST for action security_group_rules [ 624.968088] env[65359]: INFO networking_nsxv3.common.synchronization [req-a15bb97a-3a75-47fc-9822-cd7e18d0038a req-8027b2fa-72da-4ac1-bc51-903e0fe7bbbc service nova] Enqueued Resource ID: 7565297c-f219-4968-8aee-c13251599a0c with Priority: HIGHEST for action security_group_members [ 624.968088] env[65359]: INFO networking_nsxv3.common.synchronization [req-a15bb97a-3a75-47fc-9822-cd7e18d0038a req-8027b2fa-72da-4ac1-bc51-903e0fe7bbbc service nova] Enqueued Resource ID: 457b4791-1703-4ed7-9eec-af190f17a341 with Priority: HIGHEST for action port [ 624.968523] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7565297c-f219-4968-8aee-c13251599a0c with Priority: HIGHEST for action security_group_rules [ 624.968573] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7565297c-f219-4968-8aee-c13251599a0c with Priority: HIGHEST for action security_group_members [ 624.972134] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457b4791-1703-4ed7-9eec-af190f17a341 with Priority: HIGHEST for action port [ 624.972134] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7565297c-f219-4968-8aee-c13251599a0c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.972134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.972134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.972134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.972134] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7565297c-f219-4968-8aee-c13251599a0c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.972134] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-7565297c-f219-4968-8aee-c13251599a0c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.972134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.972134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.972134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.973164] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.973164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.973164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.973164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.973164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.973164] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7565297c-f219-4968-8aee-c13251599a0c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.974953] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-457b4791-1703-4ed7-9eec-af190f17a341 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.974953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-457b4791-1703-4ed7-9eec-af190f17a341" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.974953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-457b4791-1703-4ed7-9eec-af190f17a341" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.974953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-457b4791-1703-4ed7-9eec-af190f17a341" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.974953] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('457b4791-1703-4ed7-9eec-af190f17a341',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.077731] env[65359]: INFO networking_nsxv3.common.synchronization [None req-637bd44b-49cf-41a6-a5db-9dcca24adf8b tempest-ServersV294TestFqdnHostnames-1989972449 tempest-ServersV294TestFqdnHostnames-1989972449-project-member] Enqueued Resource ID: 7a31eada-fa66-45f2-8fea-2e11279344df with Priority: HIGHEST for action security_group_rules [ 625.077731] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a31eada-fa66-45f2-8fea-2e11279344df with Priority: HIGHEST for action security_group_rules [ 625.077731] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a31eada-fa66-45f2-8fea-2e11279344df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.077907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.079662] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.080014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.080117] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a31eada-fa66-45f2-8fea-2e11279344df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.432723] env[65359]: INFO networking_nsxv3.common.synchronization [None req-0147dc90-56ed-442c-a6d3-80e3ae556386 tempest-ServersV294TestFqdnHostnames-1989972449 tempest-ServersV294TestFqdnHostnames-1989972449-project-member] Enqueued Resource ID: 7a31eada-fa66-45f2-8fea-2e11279344df with Priority: HIGHEST for action security_group_rules [ 625.433559] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a31eada-fa66-45f2-8fea-2e11279344df with Priority: HIGHEST for action security_group_rules [ 625.433798] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a31eada-fa66-45f2-8fea-2e11279344df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.434219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.476425] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7565297c-f219-4968-8aee-c13251599a0c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.477822] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-7565297c-f219-4968-8aee-c13251599a0c taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.477976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.478153] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 457b4791-1703-4ed7-9eec-af190f17a341 with status ACTIVE [ 625.478429] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.479142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.479142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.479142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.479410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.479937] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.480682] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.480794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.481030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.481179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.481808] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.481808] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.482041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.485291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.485291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.485291] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 457b4791-1703-4ed7-9eec-af190f17a341 is going to be updated. [ 625.513454] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.513689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.513689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.513914] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.514050] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.514514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-457b4791-1703-4ed7-9eec-af190f17a341" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.541881] env[65359]: INFO networking_nsxv3.common.synchronization [req-5e9b70f5-10e0-4420-b7a4-3aece37a613e req-55aae0f3-91ab-4cdd-95f5-e8b828304600 tempest-ServerDiskConfigTestJSON-2085995032 tempest-ServerDiskConfigTestJSON-2085995032-project-member] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 625.541881] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 625.541881] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.541881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.541881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.541881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.541881] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.541881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.541881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.542542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.542542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.542961] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.604744] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.605568] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.608035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.608035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.608035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.608035] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a31eada-fa66-45f2-8fea-2e11279344df already deleted. [ 625.608035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.608035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.608035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.608035] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a31eada-fa66-45f2-8fea-2e11279344df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.747568] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 505f1bca-748c-4f56-9f01-2a595d335a84 in Status: SUCCESS [ 625.747837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.748484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.748615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.749053] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.749053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.749053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.749904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.750554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.750554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.750554] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('505f1bca-748c-4f56-9f01-2a595d335a84',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.914771] env[65359]: INFO networking_nsxv3.common.synchronization [None req-0b191e6e-fe48-492c-839b-444764b19b45 None None] Enqueued Resource ID: 696dd336-ff9c-47c7-980e-797c344db807 with Priority: HIGHEST for action port [ 625.915058] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 696dd336-ff9c-47c7-980e-797c344db807 with Priority: HIGHEST for action port [ 625.915628] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-696dd336-ff9c-47c7-980e-797c344db807 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.915744] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-696dd336-ff9c-47c7-980e-797c344db807" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.915850] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-696dd336-ff9c-47c7-980e-797c344db807" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.918711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-696dd336-ff9c-47c7-980e-797c344db807" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.918760] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('696dd336-ff9c-47c7-980e-797c344db807',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.976869] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-346 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.977201] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.977247] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.977589] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.977857] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.978069] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.978185] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.978408] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.978550] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.978750] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.978875] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.978981] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.979098] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.979206] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.979365] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.979497] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.985667] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7565297c-f219-4968-8aee-c13251599a0c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.999804] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.999804] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.999804] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.999804] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.000087] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.000087] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.000257] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.001034] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.001034] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.045525] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.045719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.045807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.046071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.046168] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.046362] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.046466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.046531] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.046683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.046772] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.046884] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b already deleted. [ 626.046998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.132381] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.132502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.132548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.132819] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.132819] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.133048] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a31eada-fa66-45f2-8fea-2e11279344df already deleted. [ 626.133107] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.254081] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('505f1bca-748c-4f56-9f01-2a595d335a84',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.420983] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 696dd336-ff9c-47c7-980e-797c344db807 [ 626.421983] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.422603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.422603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.422603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.422750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.422783] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:696dd336-ff9c-47c7-980e-797c344db807 already deleted. [ 626.422861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-696dd336-ff9c-47c7-980e-797c344db807" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.488130] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.488329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.488392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.488613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.488705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.488806] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7565297c-f219-4968-8aee-c13251599a0c is going to be created. [ 626.504092] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.504313] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.504433] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.504707] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.504851] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.505037] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4 not found, creating... [ 626.505274] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.505427] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.505538] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.505755] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.505887] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.506178] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.506342] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.506453] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.506653] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.506779] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.506911] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4 is going to be created. [ 626.523049] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.523296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.523416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.523743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.523995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.533630] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7565297c-f219-4968-8aee-c13251599a0c in Status: UNINITIALIZED for 2s [ 626.537340] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.537641] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.537892] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.538232] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.538491] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.538742] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.576245] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db2b8872-8032-4084-b9ac-eddda23d1176 in Status: SUCCESS [ 626.576483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.756191] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 505f1bca-748c-4f56-9f01-2a595d335a84: rpc.has_security_group_logging(os_id): False [ 626.805345] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.805637] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.805776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.806137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.806318] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.806656] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.806849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.807030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.807281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.807435] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.807842] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 505f1bca-748c-4f56-9f01-2a595d335a84 is going to be created. [ 626.896319] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.896960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.896960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.897664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.898084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.912818] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 505f1bca-748c-4f56-9f01-2a595d335a84 in Status: IN_PROGRESS for 2s [ 627.356212] env[65359]: INFO networking_nsxv3.common.synchronization [req-1e8cc294-6ea6-4044-96cb-98fb60da4121 req-b2dc61b1-d18a-49b4-a96d-b5f3a16c212c tempest-VolumesAdminNegativeTest-84973120 tempest-VolumesAdminNegativeTest-84973120-project-member] Enqueued Resource ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 with Priority: HIGHEST for action security_group_members [ 627.357085] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 with Priority: HIGHEST for action security_group_members [ 627.357085] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c3d269-f804-4fd7-b878-8a037bb5df82 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.358975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.359085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.359472] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.359661] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.359786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.359896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.360153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.360240] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.360362] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55c3d269-f804-4fd7-b878-8a037bb5df82',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.365226] env[65359]: INFO networking_nsxv3.common.synchronization [req-5e9b70f5-10e0-4420-b7a4-3aece37a613e req-24ba9a31-3c77-4a99-922c-6eee1de768a9 service nova] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_rules [ 627.365397] env[65359]: INFO networking_nsxv3.common.synchronization [req-5e9b70f5-10e0-4420-b7a4-3aece37a613e req-24ba9a31-3c77-4a99-922c-6eee1de768a9 service nova] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 627.365548] env[65359]: INFO networking_nsxv3.common.synchronization [req-5e9b70f5-10e0-4420-b7a4-3aece37a613e req-24ba9a31-3c77-4a99-922c-6eee1de768a9 service nova] Enqueued Resource ID: 7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4 with Priority: HIGHEST for action port [ 627.366610] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_rules [ 627.366733] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 627.366833] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4 with Priority: HIGHEST for action port [ 627.367353] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.367552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.367728] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.368038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.368134] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.369736] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.369993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.369993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.370094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.370402] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.370512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.370579] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.370754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.370836] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.370922] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.372320] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.372320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.372320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.372531] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.372639] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.762748] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.762973] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-390" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.763103] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-390" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.763454] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-390" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.764561] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.764750] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.764863] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.765171] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.765315] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.766176] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.766176] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.766176] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.766176] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.766176] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.766176] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.766176] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.817839] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.818010] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 627.818132] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.818331] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-390" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.818717] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-b990edba-eb1e-4d2b-8c32-2f6ce515cc73 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.818921] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-b990edba-eb1e-4d2b-8c32-2f6ce515cc73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.819016] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-b990edba-eb1e-4d2b-8c32-2f6ce515cc73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.819354] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-b990edba-eb1e-4d2b-8c32-2f6ce515cc73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.819484] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b990edba-eb1e-4d2b-8c32-2f6ce515cc73',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.867310] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.867524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.867594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.867806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.868010] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.868197] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.868350] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.868418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.868583] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.868664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.868741] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 already deleted. [ 627.868825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.876481] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.876481] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.876481] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.877756] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4 with status ACTIVE [ 627.878163] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.878353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.878453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.878773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.880008] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.880008] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.880008] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.880008] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.880008] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.880008] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.880405] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.880518] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.880594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.881255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.881255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.881255] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4 is going to be updated. [ 627.910107] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.910490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.910490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.910620] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.910720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.910893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cf5b9e5-46f4-4c8f-82b6-68d34c0002b4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.322279] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.323358] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.323358] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.323358] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.323358] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.323358] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port b990edba-eb1e-4d2b-8c32-2f6ce515cc73 not found, creating... [ 628.323631] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.323774] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.323954] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.324270] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.324484] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.324920] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.325152] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.325336] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.325821] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.326101] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.326251] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: b990edba-eb1e-4d2b-8c32-2f6ce515cc73 is going to be created. [ 628.357748] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.358075] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.358118] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.358433] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.358653] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.358949] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-b990edba-eb1e-4d2b-8c32-2f6ce515cc73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.383724] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.543481] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7565297c-f219-4968-8aee-c13251599a0c in Status: SUCCESS [ 628.543705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.543867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.544118] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.544328] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.544454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.544527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.545175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.545175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.545175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.545175] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7565297c-f219-4968-8aee-c13251599a0c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.886588] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.886851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.886851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.887290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.887290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.887290] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be created. [ 628.914333] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.914749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.914749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.914905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.915053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.929835] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: UNINITIALIZED for 2s [ 628.934469] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 505f1bca-748c-4f56-9f01-2a595d335a84 in Status: SUCCESS [ 628.934698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.047995] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-7565297c-f219-4968-8aee-c13251599a0c taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.049793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.049793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.049793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.049793] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.049793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.049793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.049793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.050447] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.050447] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.050447] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-7565297c-f219-4968-8aee-c13251599a0c taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.050618] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.050618] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.050866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.051111] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.051258] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.051371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.051631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.051694] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.051757] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.051884] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7565297c-f219-4968-8aee-c13251599a0c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.097334] env[65359]: INFO networking_nsxv3.common.synchronization [req-1e8cc294-6ea6-4044-96cb-98fb60da4121 req-07190c85-2351-4a9e-a916-b22324da73e1 service nova] Enqueued Resource ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 with Priority: HIGHEST for action security_group_rules [ 629.097334] env[65359]: INFO networking_nsxv3.common.synchronization [req-1e8cc294-6ea6-4044-96cb-98fb60da4121 req-07190c85-2351-4a9e-a916-b22324da73e1 service nova] Enqueued Resource ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 with Priority: HIGHEST for action security_group_members [ 629.097334] env[65359]: INFO networking_nsxv3.common.synchronization [req-1e8cc294-6ea6-4044-96cb-98fb60da4121 req-07190c85-2351-4a9e-a916-b22324da73e1 service nova] Enqueued Resource ID: b990edba-eb1e-4d2b-8c32-2f6ce515cc73 with Priority: HIGHEST for action port [ 629.097334] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 with Priority: HIGHEST for action security_group_rules [ 629.097334] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 with Priority: HIGHEST for action security_group_members [ 629.097334] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b990edba-eb1e-4d2b-8c32-2f6ce515cc73 with Priority: HIGHEST for action port [ 629.097334] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55c3d269-f804-4fd7-b878-8a037bb5df82 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.097334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.097334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.097334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.098017] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55c3d269-f804-4fd7-b878-8a037bb5df82',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.100466] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c3d269-f804-4fd7-b878-8a037bb5df82 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.100466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.100466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.100466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.100466] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.100466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.100466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.100466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.100466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.100466] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55c3d269-f804-4fd7-b878-8a037bb5df82',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.100942] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-b990edba-eb1e-4d2b-8c32-2f6ce515cc73 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.101103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b990edba-eb1e-4d2b-8c32-2f6ce515cc73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.101165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b990edba-eb1e-4d2b-8c32-2f6ce515cc73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.101344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b990edba-eb1e-4d2b-8c32-2f6ce515cc73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.101412] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b990edba-eb1e-4d2b-8c32-2f6ce515cc73',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.555503] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7565297c-f219-4968-8aee-c13251599a0c: rpc.has_security_group_logging(os_id): False [ 629.578380] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.578631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.578725] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.579132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.579316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.579448] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.579736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.579891] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.580088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.580179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.581468] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.581620] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.581701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.581816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.581896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.582110] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.582211] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.582310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.582414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.582488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.582575] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7565297c-f219-4968-8aee-c13251599a0c is going to be created. [ 629.604087] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55c3d269-f804-4fd7-b878-8a037bb5df82',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.605213] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c3d269-f804-4fd7-b878-8a037bb5df82 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.605378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.606192] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b990edba-eb1e-4d2b-8c32-2f6ce515cc73 with status ACTIVE [ 629.606458] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.606566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.606566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.606754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.607701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.607701] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.607701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.607701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.607701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.607701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.610367] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.611073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.611073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.611073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.611073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.611073] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b990edba-eb1e-4d2b-8c32-2f6ce515cc73 is going to be updated. [ 629.630884] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.631142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.631142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.631350] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.631486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.631655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b990edba-eb1e-4d2b-8c32-2f6ce515cc73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.634565] env[65359]: INFO networking_nsxv3.common.synchronization [req-115a06d0-8688-449d-986c-ed944f4f38b5 req-e459658c-10ec-4454-aecc-865514b65b4f tempest-FloatingIPsAssociationTestJSON-809440522 tempest-FloatingIPsAssociationTestJSON-809440522-project-member] Enqueued Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_members [ 629.635312] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_members [ 629.635676] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.635999] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.635999] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.637438] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.637730] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.637957] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.638025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.638278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.638447] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.638589] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.653036] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.653241] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.653241] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.653442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.653650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.669557] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7565297c-f219-4968-8aee-c13251599a0c in Status: IN_PROGRESS for 2s [ 630.112640] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55c3d269-f804-4fd7-b878-8a037bb5df82',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.141059] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.331020] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-184 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.331211] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-184" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.331211] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-184" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.331525] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-184" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.331811] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.331953] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.332276] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.332538] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.332683] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.332959] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.333035] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.333268] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.333268] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.333385] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.333430] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.333594] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.355115] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.355348] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.355571] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.355797] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-184" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.356258] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-da325456-61a0-47a7-b3c2-cdf0156351b1 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.356481] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-da325456-61a0-47a7-b3c2-cdf0156351b1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.356635] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-da325456-61a0-47a7-b3c2-cdf0156351b1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.357042] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-da325456-61a0-47a7-b3c2-cdf0156351b1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.357225] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da325456-61a0-47a7-b3c2-cdf0156351b1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.615721] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.616869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.616869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.616869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.616869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.616869] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 is going to be created. [ 630.643432] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.651691] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.651934] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.652262] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.652305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.653842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.669777] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 in Status: UNINITIALIZED for 2s [ 630.860190] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.860909] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.861118] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.861550] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.861791] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.862097] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port da325456-61a0-47a7-b3c2-cdf0156351b1 not found, creating... [ 630.862561] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.862832] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.863056] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.863448] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.863705] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.864759] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.865051] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.865261] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.865640] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.865881] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.866129] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: da325456-61a0-47a7-b3c2-cdf0156351b1 is going to be created. [ 630.899612] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.899886] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.900182] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.900664] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.901108] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.901318] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-da325456-61a0-47a7-b3c2-cdf0156351b1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.946251] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 630.946251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.946251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.946251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.946251] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.946251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.946251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.946251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.947046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.947348] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.947553] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.149681] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.149935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.149999] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.150297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.150404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.150519] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6cbdd6f-4665-46af-8251-3803d47cff8b is going to be updated. [ 631.191101] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.191362] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.191488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.191768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.191977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.205078] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6cbdd6f-4665-46af-8251-3803d47cff8b in Status: IN_PROGRESS for 2s [ 631.450914] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.451278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.451402] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.451710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.451990] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.452145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.452271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.452537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.452700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.452847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.453099] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.453320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.453384] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.453596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.453825] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.453992] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.454918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.455045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.455289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.455486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.455916] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.686751] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7565297c-f219-4968-8aee-c13251599a0c in Status: SUCCESS [ 631.687044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.703560] env[65359]: INFO networking_nsxv3.common.synchronization [req-115a06d0-8688-449d-986c-ed944f4f38b5 req-9e387528-77eb-48a2-b39b-0d3fcc28930e service nova] Enqueued Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_rules [ 631.703755] env[65359]: INFO networking_nsxv3.common.synchronization [req-115a06d0-8688-449d-986c-ed944f4f38b5 req-9e387528-77eb-48a2-b39b-0d3fcc28930e service nova] Enqueued Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_members [ 631.703893] env[65359]: INFO networking_nsxv3.common.synchronization [req-115a06d0-8688-449d-986c-ed944f4f38b5 req-9e387528-77eb-48a2-b39b-0d3fcc28930e service nova] Enqueued Resource ID: da325456-61a0-47a7-b3c2-cdf0156351b1 with Priority: HIGHEST for action port [ 631.705388] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_rules [ 631.705388] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_members [ 631.705388] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da325456-61a0-47a7-b3c2-cdf0156351b1 with Priority: HIGHEST for action port [ 631.705388] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.705546] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.706224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.706224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.706224] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.707587] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.707587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.707810] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-da325456-61a0-47a7-b3c2-cdf0156351b1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.707963] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da325456-61a0-47a7-b3c2-cdf0156351b1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.708073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da325456-61a0-47a7-b3c2-cdf0156351b1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.708234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da325456-61a0-47a7-b3c2-cdf0156351b1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.708738] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da325456-61a0-47a7-b3c2-cdf0156351b1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.958542] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4dca704-f8c2-494f-bbf6-802020c49b4b: rpc.has_security_group_logging(os_id): False [ 631.980778] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.981072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.981199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.981523] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.981638] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.981891] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.982165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.982165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.982319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.982552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.982645] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.983432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.983968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.983968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.983968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.983968] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.984228] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.984228] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.984420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.984420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.984420] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be created. [ 632.053356] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.053626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.053818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.054016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.054207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.069764] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: IN_PROGRESS for 2s [ 632.214250] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.214250] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.214470] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da325456-61a0-47a7-b3c2-cdf0156351b1 with status ACTIVE [ 632.214654] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.214809] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.214847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.215961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.215961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.215961] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.215961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.215961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.215961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.215961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.216410] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.216410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.216410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.216850] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.216948] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.217055] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da325456-61a0-47a7-b3c2-cdf0156351b1 is going to be updated. [ 632.267103] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.267103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.267103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.267103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.267103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.267103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da325456-61a0-47a7-b3c2-cdf0156351b1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.686077] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 in Status: SUCCESS [ 632.687438] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.687438] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.687438] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.687794] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.687794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.687794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.688035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.688035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.688267] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.688267] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55c3d269-f804-4fd7-b878-8a037bb5df82',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.194026] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c3d269-f804-4fd7-b878-8a037bb5df82 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.194225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.194286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.194514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.194727] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.194838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.194905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.195077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.195166] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.195254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.195410] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c3d269-f804-4fd7-b878-8a037bb5df82 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.195505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.195567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.195808] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.195950] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.196053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.196113] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.196253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.196328] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.196410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.196504] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55c3d269-f804-4fd7-b878-8a037bb5df82',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.217038] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6cbdd6f-4665-46af-8251-3803d47cff8b in Status: SUCCESS [ 633.217255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.217423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.217641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.217829] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.217947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.218028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.218227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.218285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.218359] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.298409] env[65359]: INFO networking_nsxv3.common.synchronization [req-5b4bfff6-c059-4b84-a525-8ca9d5bfa7b5 req-30c191c1-ba2f-46da-ac5c-3aec1c7f0f84 tempest-ServerDiagnosticsTest-1007112282 tempest-ServerDiagnosticsTest-1007112282-project-member] Enqueued Resource ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 with Priority: HIGHEST for action security_group_members [ 633.298878] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 with Priority: HIGHEST for action security_group_members [ 633.300245] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c053aa73-c45e-4ff7-9c78-5faef3e76294 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.300468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.300749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.301111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.301339] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.301479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.301576] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.301772] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.301889] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.302034] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c053aa73-c45e-4ff7-9c78-5faef3e76294',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.472819] env[65359]: INFO networking_nsxv3.common.synchronization [None req-efb76a75-a148-4925-85d6-f6b9c3117eed None None] Enqueued Resource ID: 436e0e2c-03a2-428e-a350-89a83d9d1b07 with Priority: HIGHEST for action port [ 633.473272] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 436e0e2c-03a2-428e-a350-89a83d9d1b07 with Priority: HIGHEST for action port [ 633.474718] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-436e0e2c-03a2-428e-a350-89a83d9d1b07 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.474718] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-436e0e2c-03a2-428e-a350-89a83d9d1b07" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.474718] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-436e0e2c-03a2-428e-a350-89a83d9d1b07" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.474718] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-436e0e2c-03a2-428e-a350-89a83d9d1b07" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.474718] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('436e0e2c-03a2-428e-a350-89a83d9d1b07',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.699496] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55c3d269-f804-4fd7-b878-8a037bb5df82: rpc.has_security_group_logging(os_id): False [ 633.720628] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.720784] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.720881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.721103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.721307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.721397] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.721499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.721561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.721714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.721791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.721973] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.722199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.722199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.722352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.722352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.722534] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.722629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.722690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.722830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.723009] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.723009] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 is going to be created. [ 633.724930] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.805636] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.805834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.805834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.806082] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.806197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.809764] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.809998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.810345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.810345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.810483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.810712] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.810712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.810855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.810917] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.811012] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.811103] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 is going to be updated. [ 633.828175] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 in Status: IN_PROGRESS for 2s [ 633.850025] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.850025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.850025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.850025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.850025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.863432] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 in Status: IN_PROGRESS for 2s [ 633.976417] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 436e0e2c-03a2-428e-a350-89a83d9d1b07 [ 633.976650] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.976976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.976976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.977208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.977310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.977410] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:436e0e2c-03a2-428e-a350-89a83d9d1b07 already deleted. [ 633.977493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-436e0e2c-03a2-428e-a350-89a83d9d1b07" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.085662] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 634.085915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.228262] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.247949] env[65359]: INFO networking_nsxv3.common.synchronization [None req-573a8a64-cb8f-4bc8-836f-c59775d40b75 None None] Enqueued Resource ID: faafeaa6-b236-4d35-b082-a838ca56d3ff with Priority: HIGHEST for action port [ 634.248560] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faafeaa6-b236-4d35-b082-a838ca56d3ff with Priority: HIGHEST for action port [ 634.248896] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-faafeaa6-b236-4d35-b082-a838ca56d3ff taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.249225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faafeaa6-b236-4d35-b082-a838ca56d3ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.249352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faafeaa6-b236-4d35-b082-a838ca56d3ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.250031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faafeaa6-b236-4d35-b082-a838ca56d3ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.250031] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faafeaa6-b236-4d35-b082-a838ca56d3ff',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.732612] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.732976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.732976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.733095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.733150] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.733256] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6cbdd6f-4665-46af-8251-3803d47cff8b is going to be updated. [ 634.754311] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port faafeaa6-b236-4d35-b082-a838ca56d3ff [ 634.754441] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.754587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.754656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.754876] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.754971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.755262] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:faafeaa6-b236-4d35-b082-a838ca56d3ff already deleted. [ 634.755262] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faafeaa6-b236-4d35-b082-a838ca56d3ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.842843] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.843573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.843573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.843573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.843573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.870266] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6cbdd6f-4665-46af-8251-3803d47cff8b in Status: IN_PROGRESS for 2s [ 635.849276] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 in Status: SUCCESS [ 635.849764] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.880788] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 in Status: SUCCESS [ 635.880788] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c053aa73-c45e-4ff7-9c78-5faef3e76294 deletion is rescheduled due to dependency. [ 635.880788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c053aa73-c45e-4ff7-9c78-5faef3e76294" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.524170] env[65359]: INFO networking_nsxv3.common.synchronization [None req-4f6fa65f-75ff-41ea-8f67-35fcaaec5d19 None None] Enqueued Resource ID: 510ae5de-b8b5-4b6b-a180-d9f47a65732b with Priority: HIGHEST for action port [ 636.524170] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510ae5de-b8b5-4b6b-a180-d9f47a65732b with Priority: HIGHEST for action port [ 636.524170] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-510ae5de-b8b5-4b6b-a180-d9f47a65732b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.524170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-510ae5de-b8b5-4b6b-a180-d9f47a65732b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.524170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-510ae5de-b8b5-4b6b-a180-d9f47a65732b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.525627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-510ae5de-b8b5-4b6b-a180-d9f47a65732b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.525627] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('510ae5de-b8b5-4b6b-a180-d9f47a65732b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.881234] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6cbdd6f-4665-46af-8251-3803d47cff8b in Status: SUCCESS [ 636.883330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.883330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.883330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.883489] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.883603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.883694] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.884277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.884382] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.884475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.884572] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.027403] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 510ae5de-b8b5-4b6b-a180-d9f47a65732b [ 637.027782] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.027961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.028058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.028617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.028617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.028617] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:510ae5de-b8b5-4b6b-a180-d9f47a65732b already deleted. [ 637.028617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-510ae5de-b8b5-4b6b-a180-d9f47a65732b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.184598] env[65359]: INFO networking_nsxv3.common.synchronization [None req-75d2c3a4-ee44-4284-848c-30323ce94616 None None] Enqueued Resource ID: d859944f-48ab-48ce-b218-13b770e1cc65 with Priority: HIGHEST for action port [ 637.184598] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d859944f-48ab-48ce-b218-13b770e1cc65 with Priority: HIGHEST for action port [ 637.184843] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-d859944f-48ab-48ce-b218-13b770e1cc65 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.184843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d859944f-48ab-48ce-b218-13b770e1cc65" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.184966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d859944f-48ab-48ce-b218-13b770e1cc65" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.185560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d859944f-48ab-48ce-b218-13b770e1cc65" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.185560] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d859944f-48ab-48ce-b218-13b770e1cc65',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.392088] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.392267] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.392326] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.392550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.392723] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.393044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.393044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.393177] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.393215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.395052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.395052] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.395052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.395052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.395052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.395052] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.395052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.395052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.395052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.395052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.395052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.395052] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.687294] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d859944f-48ab-48ce-b218-13b770e1cc65 [ 637.687555] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.687694] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.687755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.688023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.688112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.688210] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d859944f-48ab-48ce-b218-13b770e1cc65 already deleted. [ 637.688293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d859944f-48ab-48ce-b218-13b770e1cc65" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.898399] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6cbdd6f-4665-46af-8251-3803d47cff8b: rpc.has_security_group_logging(os_id): False [ 637.922296] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.922459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.922528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.922735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.922832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.923105] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.923226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.923292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.923466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.923544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.923724] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.923817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.923877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.924026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.924083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.924256] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.924350] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.924408] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.924542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.924618] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.924701] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6cbdd6f-4665-46af-8251-3803d47cff8b is going to be updated. [ 638.018467] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.018467] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.018650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.018836] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.018880] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.036418] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6cbdd6f-4665-46af-8251-3803d47cff8b in Status: IN_PROGRESS for 2s [ 638.305048] env[65359]: INFO networking_nsxv3.common.synchronization [req-3fcc9ea9-62f0-4837-99f4-0d659f25826c req-95de2aa5-2a6e-47b6-9911-286d663e846b tempest-ServersWithSpecificFlavorTestJSON-1171930916 tempest-ServersWithSpecificFlavorTestJSON-1171930916-project-member] Enqueued Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_members [ 638.306086] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_members [ 638.306450] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.306575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.306692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.306940] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.307135] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.307274] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.307364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.307532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.307714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.307752] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.810605] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.814354] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.814539] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.814750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.815229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.815229] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.815500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.815500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.815673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.815673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.815964] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 already deleted. [ 638.816199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.476661] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-455 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.476661] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-455" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.476661] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-455" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.477157] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-455" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.477254] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.477428] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.477537] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.477815] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.477912] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.478130] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.478239] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.478470] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.478470] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.478603] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.478653] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.478856] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.499413] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.499413] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.499413] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.499413] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-455" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.499413] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-94127df4-3842-440c-a082-fd1797c801a2 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.499413] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-94127df4-3842-440c-a082-fd1797c801a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.499413] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-94127df4-3842-440c-a082-fd1797c801a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.499722] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-94127df4-3842-440c-a082-fd1797c801a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.499899] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94127df4-3842-440c-a082-fd1797c801a2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.006021] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.006021] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.006021] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.006021] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.006021] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.006021] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 94127df4-3842-440c-a082-fd1797c801a2 not found, creating... [ 640.006021] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.006021] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.006021] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.006021] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.006021] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.006843] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.008767] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.008767] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.008992] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.009474] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.009741] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 94127df4-3842-440c-a082-fd1797c801a2 is going to be created. [ 640.036928] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.037160] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.037282] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.037563] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.037775] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.037985] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-94127df4-3842-440c-a082-fd1797c801a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.056487] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6cbdd6f-4665-46af-8251-3803d47cff8b in Status: SUCCESS [ 640.056668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.592343] env[65359]: INFO networking_nsxv3.common.synchronization [req-a390062a-c63e-458d-aca7-48d2663c9b40 req-306227f6-2c77-405d-b353-641ad347f84e tempest-ServersV294TestFqdnHostnames-1989972449 tempest-ServersV294TestFqdnHostnames-1989972449-project-member] Enqueued Resource ID: 7a31eada-fa66-45f2-8fea-2e11279344df with Priority: HIGHEST for action security_group_members [ 640.592993] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a31eada-fa66-45f2-8fea-2e11279344df with Priority: HIGHEST for action security_group_members [ 640.593384] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a31eada-fa66-45f2-8fea-2e11279344df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.593526] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.593602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.593854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.594024] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.594130] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.594439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.594544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.594613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.594880] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a31eada-fa66-45f2-8fea-2e11279344df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.759991] env[65359]: INFO networking_nsxv3.common.synchronization [req-3fcc9ea9-62f0-4837-99f4-0d659f25826c req-0c50da9a-e35e-4ce4-b6c4-1e742ea1ec53 service nova] Enqueued Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_rules [ 640.759991] env[65359]: INFO networking_nsxv3.common.synchronization [req-3fcc9ea9-62f0-4837-99f4-0d659f25826c req-0c50da9a-e35e-4ce4-b6c4-1e742ea1ec53 service nova] Enqueued Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_members [ 640.759991] env[65359]: INFO networking_nsxv3.common.synchronization [req-3fcc9ea9-62f0-4837-99f4-0d659f25826c req-0c50da9a-e35e-4ce4-b6c4-1e742ea1ec53 service nova] Enqueued Resource ID: 94127df4-3842-440c-a082-fd1797c801a2 with Priority: HIGHEST for action port [ 640.759991] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_rules [ 640.759991] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_members [ 640.759991] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94127df4-3842-440c-a082-fd1797c801a2 with Priority: HIGHEST for action port [ 640.759991] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.759991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.759991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.759991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.759991] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.761394] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.761394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.761394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.762173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.762173] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.762173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.763327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.763327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.763327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.763327] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.763607] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-94127df4-3842-440c-a082-fd1797c801a2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.763691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94127df4-3842-440c-a082-fd1797c801a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.763739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94127df4-3842-440c-a082-fd1797c801a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.763902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94127df4-3842-440c-a082-fd1797c801a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.764391] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94127df4-3842-440c-a082-fd1797c801a2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.098812] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.098812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.098812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.098812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.098812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.098812] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.098812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.098812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.098812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.098812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.098812] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a31eada-fa66-45f2-8fea-2e11279344df already deleted. [ 641.098812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.215811] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-342 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.216152] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-342" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.216427] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-342" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.216741] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-342" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.217371] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.217600] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.217693] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.218173] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.218258] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.218452] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.218754] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.218754] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.218986] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.219325] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.219532] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.219604] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.242026] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.242026] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 641.242026] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.242026] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-342" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.242501] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-950cc581-f578-4fbf-94ce-e2cd6ea09428 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.242501] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-950cc581-f578-4fbf-94ce-e2cd6ea09428" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.242711] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-950cc581-f578-4fbf-94ce-e2cd6ea09428" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.242904] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-950cc581-f578-4fbf-94ce-e2cd6ea09428" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.243111] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('950cc581-f578-4fbf-94ce-e2cd6ea09428',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.267247] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.267730] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.267908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.268167] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94127df4-3842-440c-a082-fd1797c801a2 with status ACTIVE [ 641.268350] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.268466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.268533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.268740] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.268827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.269017] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.269143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.269209] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.269365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.269446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.269621] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.269766] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.269766] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.269924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.270173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.270318] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94127df4-3842-440c-a082-fd1797c801a2 is going to be updated. [ 641.306746] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.307068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.307150] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.307753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.307753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.308139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94127df4-3842-440c-a082-fd1797c801a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.747089] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.747089] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.747089] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.747550] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.747550] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.747550] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 950cc581-f578-4fbf-94ce-e2cd6ea09428 not found, creating... [ 641.747835] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.748194] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.748341] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.748606] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.748748] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.749177] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.749404] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.749576] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.749797] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.749931] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.750155] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 950cc581-f578-4fbf-94ce-e2cd6ea09428 is going to be created. [ 641.771544] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.771774] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.771922] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.772239] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.772691] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.772988] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-950cc581-f578-4fbf-94ce-e2cd6ea09428" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.774280] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.276084] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.276084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.276310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.276395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.276484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.276583] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 is going to be created. [ 642.301545] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.301691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.301778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.302024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.302227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.313730] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 in Status: UNINITIALIZED for 2s [ 642.494915] env[65359]: INFO networking_nsxv3.common.synchronization [req-a390062a-c63e-458d-aca7-48d2663c9b40 req-77d4fec9-9a57-4556-ad88-7652c1a3b902 service nova] Enqueued Resource ID: 7a31eada-fa66-45f2-8fea-2e11279344df with Priority: HIGHEST for action security_group_rules [ 642.495117] env[65359]: INFO networking_nsxv3.common.synchronization [req-a390062a-c63e-458d-aca7-48d2663c9b40 req-77d4fec9-9a57-4556-ad88-7652c1a3b902 service nova] Enqueued Resource ID: 7a31eada-fa66-45f2-8fea-2e11279344df with Priority: HIGHEST for action security_group_members [ 642.495290] env[65359]: INFO networking_nsxv3.common.synchronization [req-a390062a-c63e-458d-aca7-48d2663c9b40 req-77d4fec9-9a57-4556-ad88-7652c1a3b902 service nova] Enqueued Resource ID: 950cc581-f578-4fbf-94ce-e2cd6ea09428 with Priority: HIGHEST for action port [ 642.495812] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a31eada-fa66-45f2-8fea-2e11279344df with Priority: HIGHEST for action security_group_rules [ 642.495951] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a31eada-fa66-45f2-8fea-2e11279344df with Priority: HIGHEST for action security_group_members [ 642.496079] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 950cc581-f578-4fbf-94ce-e2cd6ea09428 with Priority: HIGHEST for action port [ 642.496411] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a31eada-fa66-45f2-8fea-2e11279344df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.496489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.496557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.496749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.496831] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a31eada-fa66-45f2-8fea-2e11279344df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.500192] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a31eada-fa66-45f2-8fea-2e11279344df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.500192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.500192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.500192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.500192] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.500192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.500192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.500192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.500192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.500192] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a31eada-fa66-45f2-8fea-2e11279344df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.500192] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-950cc581-f578-4fbf-94ce-e2cd6ea09428 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.500192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-950cc581-f578-4fbf-94ce-e2cd6ea09428" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.500192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-950cc581-f578-4fbf-94ce-e2cd6ea09428" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.500983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-950cc581-f578-4fbf-94ce-e2cd6ea09428" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.500983] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('950cc581-f578-4fbf-94ce-e2cd6ea09428',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.826527] env[65359]: INFO networking_nsxv3.common.synchronization [req-397e9748-e182-4931-bfcc-b77e29f092c6 req-78282710-f209-4fac-9db2-6aa3d846bba1 tempest-ImagesNegativeTestJSON-1903506191 tempest-ImagesNegativeTestJSON-1903506191-project-member] Enqueued Resource ID: 7565297c-f219-4968-8aee-c13251599a0c with Priority: HIGHEST for action security_group_members [ 642.827164] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7565297c-f219-4968-8aee-c13251599a0c with Priority: HIGHEST for action security_group_members [ 642.827387] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-7565297c-f219-4968-8aee-c13251599a0c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.827515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.827580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.827875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.829492] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.829873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.829873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.829873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.830193] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.830193] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7565297c-f219-4968-8aee-c13251599a0c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.912596] env[65359]: INFO networking_nsxv3.common.synchronization [None req-b956babd-aed0-480c-b225-b2f5c748e3c9 None None] Enqueued Resource ID: edc4587d-c6c0-4f30-a9c0-d0064c483116 with Priority: HIGHEST for action port [ 642.912596] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc4587d-c6c0-4f30-a9c0-d0064c483116 with Priority: HIGHEST for action port [ 642.912596] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-edc4587d-c6c0-4f30-a9c0-d0064c483116 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.912596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edc4587d-c6c0-4f30-a9c0-d0064c483116" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.912596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edc4587d-c6c0-4f30-a9c0-d0064c483116" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.912596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edc4587d-c6c0-4f30-a9c0-d0064c483116" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.912596] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edc4587d-c6c0-4f30-a9c0-d0064c483116',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.002099] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a31eada-fa66-45f2-8fea-2e11279344df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.003555] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a31eada-fa66-45f2-8fea-2e11279344df taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.003722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.003805] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 950cc581-f578-4fbf-94ce-e2cd6ea09428 with status ACTIVE [ 643.003955] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.004106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.004155] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.004344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.004426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.004590] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.004722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.005698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.005698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.005698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.005698] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.005698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.005698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.005698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.005698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.005698] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 950cc581-f578-4fbf-94ce-e2cd6ea09428 is going to be updated. [ 643.028942] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.029140] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.029188] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.029390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.029523] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.029680] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-950cc581-f578-4fbf-94ce-e2cd6ea09428" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.334830] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.334830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.334830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.334830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.334830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.334830] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.334830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.334830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.334830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.334830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.334830] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7565297c-f219-4968-8aee-c13251599a0c is going to be updated. [ 643.369316] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.369466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.369466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.369663] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.369816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.382716] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7565297c-f219-4968-8aee-c13251599a0c in Status: IN_PROGRESS for 2s [ 643.416382] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port edc4587d-c6c0-4f30-a9c0-d0064c483116 [ 643.416647] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.416804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.416866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.417122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.417217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.417314] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:edc4587d-c6c0-4f30-a9c0-d0064c483116 already deleted. [ 643.417410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edc4587d-c6c0-4f30-a9c0-d0064c483116" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.504049] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a31eada-fa66-45f2-8fea-2e11279344df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.015573] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.016567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.016567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.016567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.016567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.016567] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a31eada-fa66-45f2-8fea-2e11279344df is going to be created. [ 644.057261] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.057462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.060387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.060387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.060387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.072693] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a31eada-fa66-45f2-8fea-2e11279344df in Status: UNINITIALIZED for 2s [ 644.326020] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 in Status: SUCCESS [ 644.326020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.326020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.326418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.326418] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.326599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.326599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.327534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.327534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.327534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.327534] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.637024] env[65359]: INFO networking_nsxv3.common.synchronization [req-3f190c81-796a-4c9a-bbd1-8428b8864c84 req-f3b54488-ae01-4d0d-9478-1f5ab86c0d76 tempest-ServersAdminTestJSON-387763736 tempest-ServersAdminTestJSON-387763736-project-member] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 644.637567] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 644.637865] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.638325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.638408] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.638614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.638808] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.638932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.638932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.639191] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.639191] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.639270] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.832188] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.058410] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-768 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.058716] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.058815] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.059095] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.059358] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.059509] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.059663] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.059894] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.060068] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.060968] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.061198] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.061246] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.061384] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.061497] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.061575] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.061725] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.083927] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.084099] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 645.084233] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.084403] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.084787] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-43b07d95-fdf4-4a7d-af72-b978378ed814 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.084951] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-43b07d95-fdf4-4a7d-af72-b978378ed814" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.085497] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-43b07d95-fdf4-4a7d-af72-b978378ed814" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.085497] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-43b07d95-fdf4-4a7d-af72-b978378ed814" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.085658] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43b07d95-fdf4-4a7d-af72-b978378ed814',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.141652] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.336034] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f33a6cb0-88e0-45c4-8990-6da48fb9f1f5: rpc.has_security_group_logging(os_id): False [ 645.359024] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.359024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.359024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.359024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.359024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.359024] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.359024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.359024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.359024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.359024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.359024] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 is going to be created. [ 645.394499] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7565297c-f219-4968-8aee-c13251599a0c in Status: SUCCESS [ 645.394663] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7565297c-f219-4968-8aee-c13251599a0c deletion is rescheduled due to dependency. [ 645.394732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.444909] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.444909] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.444909] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.444909] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.444909] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.456778] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 in Status: IN_PROGRESS for 2s [ 645.588271] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.588520] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.588627] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.588913] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.589071] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.589224] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 43b07d95-fdf4-4a7d-af72-b978378ed814 not found, creating... [ 645.589483] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.590042] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.590042] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.590042] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.590160] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.590484] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.590647] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.590647] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.590985] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.590985] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.591169] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 43b07d95-fdf4-4a7d-af72-b978378ed814 is going to be created. [ 645.612570] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.612772] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.612887] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.613201] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.613390] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.613603] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-43b07d95-fdf4-4a7d-af72-b978378ed814" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.645292] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.084566] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a31eada-fa66-45f2-8fea-2e11279344df in Status: SUCCESS [ 646.084936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.084977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.085706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.085706] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.085706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.085706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.085706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.086018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.086018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.086018] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a31eada-fa66-45f2-8fea-2e11279344df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.148332] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.148554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.148613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.148797] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.149494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.149494] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be updated. [ 646.183913] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.184100] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.184170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.184403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.184568] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.194454] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 646.228208] env[65359]: INFO networking_nsxv3.common.synchronization [None req-5fdf8115-c165-4cdf-b3dd-5adaf01bf86e None None] Enqueued Resource ID: 45f51b0d-3621-451c-846f-cc6e32cee83f with Priority: HIGHEST for action port [ 646.228934] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45f51b0d-3621-451c-846f-cc6e32cee83f with Priority: HIGHEST for action port [ 646.229433] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-45f51b0d-3621-451c-846f-cc6e32cee83f taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.229593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45f51b0d-3621-451c-846f-cc6e32cee83f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.229685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45f51b0d-3621-451c-846f-cc6e32cee83f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.230504] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45f51b0d-3621-451c-846f-cc6e32cee83f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.230504] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45f51b0d-3621-451c-846f-cc6e32cee83f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.351594] env[65359]: INFO networking_nsxv3.common.synchronization [req-3f190c81-796a-4c9a-bbd1-8428b8864c84 req-58f23a4a-5397-4bc3-8ba6-4bb993365373 service nova] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_rules [ 646.351719] env[65359]: INFO networking_nsxv3.common.synchronization [req-3f190c81-796a-4c9a-bbd1-8428b8864c84 req-58f23a4a-5397-4bc3-8ba6-4bb993365373 service nova] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 646.351899] env[65359]: INFO networking_nsxv3.common.synchronization [req-3f190c81-796a-4c9a-bbd1-8428b8864c84 req-58f23a4a-5397-4bc3-8ba6-4bb993365373 service nova] Enqueued Resource ID: 43b07d95-fdf4-4a7d-af72-b978378ed814 with Priority: HIGHEST for action port [ 646.352501] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_rules [ 646.352708] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 646.352900] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43b07d95-fdf4-4a7d-af72-b978378ed814 with Priority: HIGHEST for action port [ 646.354764] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.354991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.355181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.355300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.355757] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.357883] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.358103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.358276] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-43b07d95-fdf4-4a7d-af72-b978378ed814 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.358359] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43b07d95-fdf4-4a7d-af72-b978378ed814" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.358424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43b07d95-fdf4-4a7d-af72-b978378ed814" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.358610] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43b07d95-fdf4-4a7d-af72-b978378ed814" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.358691] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43b07d95-fdf4-4a7d-af72-b978378ed814',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.450960] env[65359]: INFO networking_nsxv3.common.synchronization [None req-6bdd0363-0900-424c-beb5-49e2f8df79d4 tempest-AttachInterfacesUnderV243Test-943312976 tempest-AttachInterfacesUnderV243Test-943312976-project-member] Enqueued Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_rules [ 646.451606] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_rules [ 646.452861] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.452861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.452963] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.453204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.453297] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.571771] env[65359]: INFO networking_nsxv3.common.synchronization [None req-5755b159-c3ff-4b69-9b75-a71cee535c65 tempest-AttachInterfacesUnderV243Test-943312976 tempest-AttachInterfacesUnderV243Test-943312976-project-member] Enqueued Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_rules [ 646.571771] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_rules [ 646.571771] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.571771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.588132] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a31eada-fa66-45f2-8fea-2e11279344df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.732886] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45f51b0d-3621-451c-846f-cc6e32cee83f [ 646.733359] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.733517] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.733612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.733829] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.733944] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.734083] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45f51b0d-3621-451c-846f-cc6e32cee83f already deleted. [ 646.734214] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45f51b0d-3621-451c-846f-cc6e32cee83f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.862454] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.862454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.862454] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43b07d95-fdf4-4a7d-af72-b978378ed814 with status ACTIVE [ 646.862723] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.862723] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.862813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.863394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.863394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.863523] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.863523] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.863620] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.866621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.866621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.866621] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.866621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.866621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.866621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.866621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.866621] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43b07d95-fdf4-4a7d-af72-b978378ed814 is going to be updated. [ 646.896965] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.896965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.896965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.896965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.896965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.896965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43b07d95-fdf4-4a7d-af72-b978378ed814" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.989527] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.989826] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.989826] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.990226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.990226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.990430] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 703826e2-1d66-436e-9721-f997727e26c4 already deleted. [ 646.990430] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.990604] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.990810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.990889] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.091262] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a31eada-fa66-45f2-8fea-2e11279344df: rpc.has_security_group_logging(os_id): False [ 647.118235] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.118235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.118235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.118235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.118235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.118235] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.118235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.118235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.118867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.118867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.118867] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a31eada-fa66-45f2-8fea-2e11279344df is going to be created. [ 647.204037] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.204037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.204037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.204339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.204433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.220482] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a31eada-fa66-45f2-8fea-2e11279344df in Status: IN_PROGRESS for 2s [ 647.476130] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 in Status: SUCCESS [ 647.476534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.522560] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.522789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.522789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.523056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.523153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.524016] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 703826e2-1d66-436e-9721-f997727e26c4 already deleted. [ 647.524879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.587656] env[65359]: INFO networking_nsxv3.common.synchronization [req-586161d7-929f-4a71-b521-24aa39bd7359 req-1a26770f-1179-4fdf-83f0-4c45d932d9bd tempest-ImagesTestJSON-1497561183 tempest-ImagesTestJSON-1497561183-project-member] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 647.588841] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 647.589613] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.589782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.589864] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.590263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.590476] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.590588] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.590654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.590830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.590934] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.591352] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.098861] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.099218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.099218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.099828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.099949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.100204] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.100332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.100411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.100582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.100674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.100745] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 already deleted. [ 648.100816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.121872] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-189 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.121872] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.121872] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.122382] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.122807] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.123016] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.123167] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.123444] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.123615] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.123853] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.123996] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.124175] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.124312] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.124444] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.124588] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.124983] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.147113] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.147351] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 648.147351] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.147574] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.147972] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.148193] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.148268] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.148573] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.148767] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.206420] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 648.206420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.206420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.206420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.206420] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.206420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.206420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.206420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.206420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.206420] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.651428] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.651655] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.652060] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.652169] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.652217] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.652357] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3 not found, creating... [ 648.652697] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.652803] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.652873] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.653107] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.653232] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.653504] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.653642] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.653745] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.653935] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.654119] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.654353] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3 is going to be created. [ 648.674733] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.674953] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.675711] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.675711] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.675711] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.676061] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.708871] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.210835] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.237305] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a31eada-fa66-45f2-8fea-2e11279344df in Status: SUCCESS [ 649.237631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.420974] env[65359]: INFO networking_nsxv3.common.synchronization [req-586161d7-929f-4a71-b521-24aa39bd7359 req-1a90b2d6-f49a-4abe-8a69-011fa849c8a8 service nova] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_rules [ 649.421151] env[65359]: INFO networking_nsxv3.common.synchronization [req-586161d7-929f-4a71-b521-24aa39bd7359 req-1a90b2d6-f49a-4abe-8a69-011fa849c8a8 service nova] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 649.421402] env[65359]: INFO networking_nsxv3.common.synchronization [req-586161d7-929f-4a71-b521-24aa39bd7359 req-1a90b2d6-f49a-4abe-8a69-011fa849c8a8 service nova] Enqueued Resource ID: a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3 with Priority: HIGHEST for action port [ 649.421881] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_rules [ 649.422103] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 649.422279] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3 with Priority: HIGHEST for action port [ 649.422620] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.422804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.422804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.423232] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.423232] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.424128] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.424293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.424632] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.424632] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.424786] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.424879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.424938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.425086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.425208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.425312] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.427260] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.427477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.427477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.427665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.428631] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.486138] env[65359]: INFO networking_nsxv3.common.synchronization [None req-e1b6bc31-68e0-4c53-84de-95a0acf74b18 None None] Enqueued Resource ID: 6a53b1a1-4639-4738-9e58-f8cb87013169 with Priority: HIGHEST for action port [ 649.486962] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a53b1a1-4639-4738-9e58-f8cb87013169 with Priority: HIGHEST for action port [ 649.486962] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a53b1a1-4639-4738-9e58-f8cb87013169 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.487305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a53b1a1-4639-4738-9e58-f8cb87013169" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.487305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a53b1a1-4639-4738-9e58-f8cb87013169" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.487626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a53b1a1-4639-4738-9e58-f8cb87013169" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.487626] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a53b1a1-4639-4738-9e58-f8cb87013169',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.715842] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.716108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.716108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.716343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.716433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.716559] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be updated. [ 649.752804] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.753028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.753084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.753276] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.753422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.756890] env[65359]: INFO networking_nsxv3.common.synchronization [req-ca87eda5-c1ec-497b-b21b-621043d63dc1 req-5ff0787d-8b60-469a-b6bf-a6b4687b81fe tempest-ServersNegativeTestMultiTenantJSON-938396851 tempest-ServersNegativeTestMultiTenantJSON-938396851-project-member] Enqueued Resource ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 with Priority: HIGHEST for action security_group_members [ 649.757412] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 with Priority: HIGHEST for action security_group_members [ 649.757709] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.757831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.757912] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.758110] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.758267] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.758367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.758425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.758570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.758657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.758748] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316dc9d7-17d3-414d-ba0c-8e1fd143cf19',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.764152] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 649.931078] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3 with status ACTIVE [ 649.931352] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.931491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.931557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.931791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.931916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.932139] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.932246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.932318] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.932507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.932590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.932776] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.932872] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.932935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.933123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.933208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.933294] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3 is going to be updated. [ 649.936061] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.938322] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.938322] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.963463] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.963625] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.963697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.963908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.964062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.964226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9e82c27-c3a5-41d1-8b2a-cb2e5721dde3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.968339] env[65359]: INFO networking_nsxv3.common.synchronization [req-145a3a65-9c73-4360-ab7b-824c0e8b3084 req-f95a904d-3fed-4f7d-b5a3-5fcccad8c61e tempest-InstanceActionsNegativeTestJSON-190275811 tempest-InstanceActionsNegativeTestJSON-190275811-project-member] Enqueued Resource ID: db2b8872-8032-4084-b9ac-eddda23d1176 with Priority: HIGHEST for action security_group_members [ 649.968880] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2b8872-8032-4084-b9ac-eddda23d1176 with Priority: HIGHEST for action security_group_members [ 649.970513] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-db2b8872-8032-4084-b9ac-eddda23d1176 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.971112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.971445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.971761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.972538] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.972683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.973052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.973274] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.973673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.973808] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db2b8872-8032-4084-b9ac-eddda23d1176',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.991115] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a53b1a1-4639-4738-9e58-f8cb87013169 [ 649.991115] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.991115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.991115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.991115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.991115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.991115] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a53b1a1-4639-4738-9e58-f8cb87013169 already deleted. [ 649.991448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a53b1a1-4639-4738-9e58-f8cb87013169" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.261337] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.261627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.261627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.261809] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.261954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.262194] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.262315] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.262370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.262530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.262600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.262722] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 is going to be updated. [ 650.300255] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.300255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.300255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.300563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.300563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.311952] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 in Status: IN_PROGRESS for 2s [ 650.439815] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.478800] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.479083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.479142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.479375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.479466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.479674] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.479799] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.479861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.480035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.480159] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.480257] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db2b8872-8032-4084-b9ac-eddda23d1176 is going to be updated. [ 650.509537] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.509627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.509627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.509871] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.510034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.523919] env[65359]: INFO networking_nsxv3.common.synchronization [req-855867bd-8db9-4188-9b33-e83871a6760a req-1419990e-47fe-4824-a83e-566cea1ecd49 tempest-DeleteServersAdminTestJSON-1164442439 tempest-DeleteServersAdminTestJSON-1164442439-project-member] Enqueued Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_members [ 650.525514] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2b8872-8032-4084-b9ac-eddda23d1176 in Status: IN_PROGRESS for 2s [ 650.527452] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_members [ 650.527452] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c01e6ff-b831-4d21-8c9a-e3a067190d76 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.527452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.527452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.527452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.527452] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.527452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.527452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.527452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.527452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.527452] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.948459] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.948459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.948459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.948459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.948459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.948459] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be created. [ 650.962030] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.962030] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.962030] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.962475] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.962813] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.962989] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.963140] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.963386] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.963648] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.964245] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.964245] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.964736] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.964736] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.964891] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.965097] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.965340] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.986275] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.986275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.986275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.988626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.988626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.990725] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.992027] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.992027] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.992027] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.992027] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-ed8f521a-5820-4d14-9ea3-e38b72d61c66 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.992027] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-ed8f521a-5820-4d14-9ea3-e38b72d61c66" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.992447] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-ed8f521a-5820-4d14-9ea3-e38b72d61c66" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.992849] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-ed8f521a-5820-4d14-9ea3-e38b72d61c66" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.993149] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed8f521a-5820-4d14-9ea3-e38b72d61c66',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.004186] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: UNINITIALIZED for 2s [ 651.030899] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.030899] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.030899] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.030899] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.031335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.031335] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.031335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.031477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.031564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.031643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.031745] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 is going to be updated. [ 651.071387] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.071569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.071636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.071892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.072054] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.082967] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 in Status: IN_PROGRESS for 2s [ 651.496150] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.496514] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.496755] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.497057] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.497211] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.497373] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port ed8f521a-5820-4d14-9ea3-e38b72d61c66 not found, creating... [ 651.497648] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.497805] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.497912] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.498225] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.498373] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.498667] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.499466] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.499627] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.500682] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.500859] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.501056] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: ed8f521a-5820-4d14-9ea3-e38b72d61c66 is going to be created. [ 651.533869] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.534115] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.534222] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.534511] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.534734] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.535289] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-ed8f521a-5820-4d14-9ea3-e38b72d61c66" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.777562] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 651.777806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.778103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.778435] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.778652] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.778783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.778855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.779042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.779134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.779225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.779325] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.282805] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.282966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.283036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.284135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.284202] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.284265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.284340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.284525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.284641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.284738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.284892] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.284989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.285179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.285367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.285543] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.285750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.285750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.285907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.287305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.287305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.287305] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.287789] env[65359]: INFO networking_nsxv3.common.synchronization [req-855867bd-8db9-4188-9b33-e83871a6760a req-452e627b-63c9-4b63-b659-bc4b0bcc59ef service nova] Enqueued Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_rules [ 652.288070] env[65359]: INFO networking_nsxv3.common.synchronization [req-855867bd-8db9-4188-9b33-e83871a6760a req-452e627b-63c9-4b63-b659-bc4b0bcc59ef service nova] Enqueued Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_members [ 652.288613] env[65359]: INFO networking_nsxv3.common.synchronization [req-855867bd-8db9-4188-9b33-e83871a6760a req-452e627b-63c9-4b63-b659-bc4b0bcc59ef service nova] Enqueued Resource ID: ed8f521a-5820-4d14-9ea3-e38b72d61c66 with Priority: HIGHEST for action port [ 652.290329] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_rules [ 652.290500] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_members [ 652.290629] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed8f521a-5820-4d14-9ea3-e38b72d61c66 with Priority: HIGHEST for action port [ 652.292034] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c01e6ff-b831-4d21-8c9a-e3a067190d76 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.292034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.292034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.292034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.292034] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.292594] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c01e6ff-b831-4d21-8c9a-e3a067190d76 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.292594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.292970] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed8f521a-5820-4d14-9ea3-e38b72d61c66 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.293106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed8f521a-5820-4d14-9ea3-e38b72d61c66" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.293174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed8f521a-5820-4d14-9ea3-e38b72d61c66" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.293338] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed8f521a-5820-4d14-9ea3-e38b72d61c66" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.293413] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed8f521a-5820-4d14-9ea3-e38b72d61c66',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.325340] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 in Status: SUCCESS [ 652.325529] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316dc9d7-17d3-414d-ba0c-8e1fd143cf19 deletion is rescheduled due to dependency. [ 652.325629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316dc9d7-17d3-414d-ba0c-8e1fd143cf19" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.537266] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db2b8872-8032-4084-b9ac-eddda23d1176 in Status: SUCCESS [ 652.537654] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db2b8872-8032-4084-b9ac-eddda23d1176 deletion is rescheduled due to dependency. [ 652.537654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.584035] env[65359]: INFO networking_nsxv3.common.synchronization [None req-52a71ad1-c433-44a2-8e71-6a08acb17194 None None] Enqueued Resource ID: d2b486a4-1ba9-4a7d-a010-141ca11e7eee with Priority: HIGHEST for action port [ 652.585321] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b486a4-1ba9-4a7d-a010-141ca11e7eee with Priority: HIGHEST for action port [ 652.586126] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2b486a4-1ba9-4a7d-a010-141ca11e7eee taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.586126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2b486a4-1ba9-4a7d-a010-141ca11e7eee" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.586308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2b486a4-1ba9-4a7d-a010-141ca11e7eee" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.586455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2b486a4-1ba9-4a7d-a010-141ca11e7eee" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.586495] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2b486a4-1ba9-4a7d-a010-141ca11e7eee',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.789738] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6eb7ac19-945a-427f-84cb-cc4a488527fc: rpc.has_security_group_logging(os_id): False [ 652.795737] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c01e6ff-b831-4d21-8c9a-e3a067190d76 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.795878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.796050] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed8f521a-5820-4d14-9ea3-e38b72d61c66 with status ACTIVE [ 652.796236] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.796342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.796405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.796614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.796700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.796867] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.796962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.797029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.797199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.797302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.797482] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.797574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.797633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.797784] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.797845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.797929] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed8f521a-5820-4d14-9ea3-e38b72d61c66 is going to be updated. [ 652.818868] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.819044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.819115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.819333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.819420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.819668] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.819780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.819938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.820044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.820137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.820412] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.820412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.820529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.820706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.820706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.820887] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.820982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.821243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.821480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.821583] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.821690] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be updated. [ 652.830237] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.830420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.830490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.830755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.830828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.831010] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed8f521a-5820-4d14-9ea3-e38b72d61c66" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.896569] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.896569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.896569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.896730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.896730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.916260] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 653.018201] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 653.019195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.019195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.019195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.019195] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.019195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.019195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.019780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.019780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.019780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.019780] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.089789] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d2b486a4-1ba9-4a7d-a010-141ca11e7eee [ 653.090128] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.090288] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.090369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.090665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.090831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.090979] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d2b486a4-1ba9-4a7d-a010-141ca11e7eee already deleted. [ 653.091155] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2b486a4-1ba9-4a7d-a010-141ca11e7eee" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.094938] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 in Status: SUCCESS [ 653.097750] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 deletion is rescheduled due to dependency. [ 653.097750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.097750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.097750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.097750] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.097750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.097750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.097750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.097750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.097750] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.523936] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.524139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.524208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.524478] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.524635] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.524738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.524738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.524894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.524979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.525085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.525246] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.525340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.525402] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.525610] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.525756] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.525851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.525908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.526063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.526143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.526229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.526320] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.600764] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.738026] env[65359]: INFO networking_nsxv3.common.synchronization [req-62ca0f28-44dc-4d26-8236-a32c92cf144f req-34294cad-54ce-43be-aa99-4f95f94c134d tempest-ServersAdminNegativeTestJSON-660584843 tempest-ServersAdminNegativeTestJSON-660584843-project-member] Enqueued Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_members [ 653.739105] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_members [ 653.739764] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-582cfc14-9eeb-4704-a95a-052a5b40435e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.739764] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.739923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.740273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.740512] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.740668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.740762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.740995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.741298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.741477] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.030500] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28737c44-388f-4cb8-9cac-0181cbb28981: rpc.has_security_group_logging(os_id): False [ 654.049995] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.050161] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.050233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.050453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.050549] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.050772] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.050874] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.050934] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.051128] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.051221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.051534] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.051534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.051628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.051744] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.051934] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.052015] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.052452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.052627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.052891] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.053067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.053349] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be created. [ 654.103233] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.122793] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.122945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.123066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.123289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.123587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.128240] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.128417] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.128580] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.128934] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.129235] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.129396] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.129512] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.130488] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.130488] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.130488] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.130488] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.130488] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.130488] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.130488] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.130771] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.130771] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.143628] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 654.151886] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.152073] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.152198] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.152364] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.152713] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-c8cd7fa3-da03-4272-bb68-3d4b45e96b8a taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.152964] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-c8cd7fa3-da03-4272-bb68-3d4b45e96b8a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.153016] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-c8cd7fa3-da03-4272-bb68-3d4b45e96b8a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.154028] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-c8cd7fa3-da03-4272-bb68-3d4b45e96b8a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.154028] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8cd7fa3-da03-4272-bb68-3d4b45e96b8a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.246216] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.246216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.246216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.246216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.246216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.246216] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.246216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.246216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.246216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.246216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.246216] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 582cfc14-9eeb-4704-a95a-052a5b40435e already deleted. [ 654.246216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.605771] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.606084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.606084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.606308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.606365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.606441] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 is going to be updated. [ 654.635971] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.636235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.636235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.636443] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.636596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.646932] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 in Status: IN_PROGRESS for 2s [ 654.658028] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.658818] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.658818] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.658818] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.659047] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.659817] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port c8cd7fa3-da03-4272-bb68-3d4b45e96b8a not found, creating... [ 654.659817] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.659817] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.660274] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.660274] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.660374] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.660767] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.661015] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.661148] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.661439] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.661485] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.661615] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: c8cd7fa3-da03-4272-bb68-3d4b45e96b8a is going to be created. [ 654.687822] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.688116] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.688223] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.688597] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.688954] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.689432] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-c8cd7fa3-da03-4272-bb68-3d4b45e96b8a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.942042] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 654.942396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.423175] env[65359]: INFO networking_nsxv3.common.synchronization [req-62ca0f28-44dc-4d26-8236-a32c92cf144f req-ccbce537-9097-4991-b9d2-f6e4a4fccc3f service nova] Enqueued Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_rules [ 655.423359] env[65359]: INFO networking_nsxv3.common.synchronization [req-62ca0f28-44dc-4d26-8236-a32c92cf144f req-ccbce537-9097-4991-b9d2-f6e4a4fccc3f service nova] Enqueued Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_members [ 655.423487] env[65359]: INFO networking_nsxv3.common.synchronization [req-62ca0f28-44dc-4d26-8236-a32c92cf144f req-ccbce537-9097-4991-b9d2-f6e4a4fccc3f service nova] Enqueued Resource ID: c8cd7fa3-da03-4272-bb68-3d4b45e96b8a with Priority: HIGHEST for action port [ 655.424011] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_rules [ 655.424153] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_members [ 655.424254] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8cd7fa3-da03-4272-bb68-3d4b45e96b8a with Priority: HIGHEST for action port [ 655.424522] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-582cfc14-9eeb-4704-a95a-052a5b40435e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.424702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.424702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.425416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.426401] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.427645] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-582cfc14-9eeb-4704-a95a-052a5b40435e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.427775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.427843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.428063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.428234] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.428332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.429425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.429425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.429425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.429425] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.430032] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8cd7fa3-da03-4272-bb68-3d4b45e96b8a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.430227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8cd7fa3-da03-4272-bb68-3d4b45e96b8a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.430320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8cd7fa3-da03-4272-bb68-3d4b45e96b8a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.435122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8cd7fa3-da03-4272-bb68-3d4b45e96b8a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.435122] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8cd7fa3-da03-4272-bb68-3d4b45e96b8a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.933763] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.935977] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-582cfc14-9eeb-4704-a95a-052a5b40435e taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.936655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.936655] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8cd7fa3-da03-4272-bb68-3d4b45e96b8a with status ACTIVE [ 655.936900] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.937174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.937329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.937689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.940753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.940753] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.940753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.940753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.940753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.940753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.940753] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.940753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.940753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.940753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.940753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.940753] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8cd7fa3-da03-4272-bb68-3d4b45e96b8a is going to be updated. [ 655.961579] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.963020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.963020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.963020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.963020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.963020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8cd7fa3-da03-4272-bb68-3d4b45e96b8a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.156617] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 656.156617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.441635] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.664477] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 in Status: SUCCESS [ 656.664709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.664890] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.665248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.665479] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.665609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.665674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.665892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.666015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.667462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.667462] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.749072] env[65359]: INFO networking_nsxv3.common.synchronization [req-b5808abc-f1c3-4a1e-84e5-8332a9dbb83a req-ff98c6b9-b47c-4fb7-b8b3-00f3eb8b43c9 tempest-VolumesAdminNegativeTest-84973120 tempest-VolumesAdminNegativeTest-84973120-project-member] Enqueued Resource ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 with Priority: HIGHEST for action security_group_members [ 656.749815] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 with Priority: HIGHEST for action security_group_members [ 656.750556] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c3d269-f804-4fd7-b878-8a037bb5df82 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.750732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.750840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.751107] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.751398] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.752650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.753047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.753047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.753151] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.753345] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55c3d269-f804-4fd7-b878-8a037bb5df82',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.946931] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.946931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.946931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.946931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.946931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.946931] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 582cfc14-9eeb-4704-a95a-052a5b40435e is going to be created. [ 656.976918] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.976918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.976918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.976918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.976918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.987348] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: UNINITIALIZED for 2s [ 657.171162] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c01e6ff-b831-4d21-8c9a-e3a067190d76 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.171358] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.171430] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.171747] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.171952] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.172639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.172639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.172639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.172639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.172639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.172639] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c01e6ff-b831-4d21-8c9a-e3a067190d76 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.172968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.172968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.172968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.173088] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.173178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.173247] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.173788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.173788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.173788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.173788] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.256230] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.256547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.256547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.256738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.257424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.257424] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.257424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.257424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.257424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.257783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.257783] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 is going to be updated. [ 657.295027] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.295211] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.295297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.295514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.295656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.306669] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 in Status: IN_PROGRESS for 2s [ 657.679644] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c01e6ff-b831-4d21-8c9a-e3a067190d76: rpc.has_security_group_logging(os_id): False [ 657.699304] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.699666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.699666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.699806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.700389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.700389] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.700389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.700389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.700715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.700715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.700715] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.700846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.700885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.700987] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.701085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.701272] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.701371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.701427] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.701558] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.701629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.701716] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 is going to be updated. [ 657.807874] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.808125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.808260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.808537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.808740] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.839154] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 in Status: IN_PROGRESS for 2s [ 658.999729] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: SUCCESS [ 659.000165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.000165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.000484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.000713] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.000855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.000910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.001100] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.001269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.001269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.001398] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.321132] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 in Status: SUCCESS [ 659.321313] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 deletion is rescheduled due to dependency. [ 659.321789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.505123] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-582cfc14-9eeb-4704-a95a-052a5b40435e taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.505123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.505123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.505123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.505123] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.505123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.505569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.505569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.505569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.505672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.505967] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-582cfc14-9eeb-4704-a95a-052a5b40435e taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.505967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.506144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.506261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.506501] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.506609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.507145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.507145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.507145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.507145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.507145] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.855770] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 in Status: SUCCESS [ 659.856140] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.010938] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 582cfc14-9eeb-4704-a95a-052a5b40435e: rpc.has_security_group_logging(os_id): False [ 660.036219] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.036774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.037141] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.039631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.039748] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.040015] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.040138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.040227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.040420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.040525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.040797] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.040950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.042838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.042838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.042838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.042838] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.042838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.042838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.042838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.042838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.042838] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 582cfc14-9eeb-4704-a95a-052a5b40435e is going to be created. [ 660.110440] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.110588] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.110653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.110902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.112990] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.124055] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: IN_PROGRESS for 2s [ 660.658258] env[65359]: INFO networking_nsxv3.common.synchronization [req-05e11b88-cdf8-4f3e-abc6-33c86fb7920a req-222474d0-f3b1-4793-b0fd-7df8f001b22d tempest-InstanceActionsTestJSON-1555854732 tempest-InstanceActionsTestJSON-1555854732-project-member] Enqueued Resource ID: 78b29888-5f88-401c-8a70-59d4c410c80d with Priority: HIGHEST for action security_group_members [ 660.658587] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b29888-5f88-401c-8a70-59d4c410c80d with Priority: HIGHEST for action security_group_members [ 660.658901] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b29888-5f88-401c-8a70-59d4c410c80d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.659580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.659580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.659580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.659580] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.659580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.659821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.659821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.659915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.660096] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b29888-5f88-401c-8a70-59d4c410c80d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.162564] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.162564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.162564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.162968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.162968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.164329] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.166437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.166437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.166437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.166437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.166437] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b29888-5f88-401c-8a70-59d4c410c80d is going to be updated. [ 661.199129] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.199129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.199129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.199476] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.199476] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.209587] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b29888-5f88-401c-8a70-59d4c410c80d in Status: IN_PROGRESS for 2s [ 662.136889] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: SUCCESS [ 662.137154] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.204847] env[65359]: INFO networking_nsxv3.common.synchronization [None req-148ea4b9-2f3c-4385-b3f9-d77fe09d2019 None None] Enqueued Resource ID: 30f76ce5-d98b-4d8c-a0fe-913070bf243b with Priority: HIGHEST for action port [ 663.205470] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f76ce5-d98b-4d8c-a0fe-913070bf243b with Priority: HIGHEST for action port [ 663.205806] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-30f76ce5-d98b-4d8c-a0fe-913070bf243b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.205934] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30f76ce5-d98b-4d8c-a0fe-913070bf243b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.205994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30f76ce5-d98b-4d8c-a0fe-913070bf243b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.206275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30f76ce5-d98b-4d8c-a0fe-913070bf243b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.206357] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30f76ce5-d98b-4d8c-a0fe-913070bf243b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.221080] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b29888-5f88-401c-8a70-59d4c410c80d in Status: SUCCESS [ 663.221294] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b29888-5f88-401c-8a70-59d4c410c80d deletion is rescheduled due to dependency. [ 663.221385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.709123] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30f76ce5-d98b-4d8c-a0fe-913070bf243b [ 663.709689] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.709907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.710046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.710383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.710527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.712074] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30f76ce5-d98b-4d8c-a0fe-913070bf243b already deleted. [ 663.712074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30f76ce5-d98b-4d8c-a0fe-913070bf243b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.294904] env[65359]: INFO networking_nsxv3.common.synchronization [req-19873d87-517c-47ee-8abc-836ca5636e9c req-c22878e5-bfdb-45f3-840d-474f1db741b3 tempest-AttachInterfacesUnderV243Test-943312976 tempest-AttachInterfacesUnderV243Test-943312976-project-member] Enqueued Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_members [ 665.297465] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_members [ 665.297465] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.297465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.297465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.297872] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.298095] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.300066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.300066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.300066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.300066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.300066] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.767927] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-807 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.767927] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-807" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.767927] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-807" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.768112] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-807" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.768266] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.768381] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.768491] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.768696] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.768829] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.769575] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.770488] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.770667] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.770785] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.770915] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.771035] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.771167] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.792390] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.792540] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 665.793239] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.793239] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-807" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.793239] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-7a774f65-eb86-4cb0-9805-e0988c11cded taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.793497] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.793585] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.793904] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.794058] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a774f65-eb86-4cb0-9805-e0988c11cded',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.803473] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.803473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.803473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.803473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.803473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.803473] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.803473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.803473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.803473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.803473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.803473] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 703826e2-1d66-436e-9721-f997727e26c4 already deleted. [ 665.803473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.897719] env[65359]: INFO networking_nsxv3.common.synchronization [None req-ad12ff70-16b0-4b5d-8876-4bf871f9a3f0 None None] Enqueued Resource ID: 5530cb77-0ff7-427b-ada7-cf6864273f02 with Priority: HIGHEST for action port [ 665.898882] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5530cb77-0ff7-427b-ada7-cf6864273f02 with Priority: HIGHEST for action port [ 665.898882] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-5530cb77-0ff7-427b-ada7-cf6864273f02 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.898882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5530cb77-0ff7-427b-ada7-cf6864273f02" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.898882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5530cb77-0ff7-427b-ada7-cf6864273f02" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.899388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5530cb77-0ff7-427b-ada7-cf6864273f02" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.899482] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5530cb77-0ff7-427b-ada7-cf6864273f02',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.298592] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.298592] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.298592] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.299054] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.299185] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.299665] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 7a774f65-eb86-4cb0-9805-e0988c11cded not found, creating... [ 666.299756] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.299961] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.301212] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.301212] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.301363] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.301688] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.301871] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.301952] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.302202] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.302332] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.302469] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 7a774f65-eb86-4cb0-9805-e0988c11cded is going to be created. [ 666.325144] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.325359] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.325463] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.325842] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.326104] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.326325] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.402145] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5530cb77-0ff7-427b-ada7-cf6864273f02 [ 666.402692] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.402916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.402916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.403165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.403308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.403458] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5530cb77-0ff7-427b-ada7-cf6864273f02 already deleted. [ 666.403586] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5530cb77-0ff7-427b-ada7-cf6864273f02" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.066606] env[65359]: INFO networking_nsxv3.common.synchronization [req-19873d87-517c-47ee-8abc-836ca5636e9c req-3de363d9-2f72-4ac2-a485-6a2f995b58c8 service nova] Enqueued Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_rules [ 667.066797] env[65359]: INFO networking_nsxv3.common.synchronization [req-19873d87-517c-47ee-8abc-836ca5636e9c req-3de363d9-2f72-4ac2-a485-6a2f995b58c8 service nova] Enqueued Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_members [ 667.066925] env[65359]: INFO networking_nsxv3.common.synchronization [req-19873d87-517c-47ee-8abc-836ca5636e9c req-3de363d9-2f72-4ac2-a485-6a2f995b58c8 service nova] Enqueued Resource ID: 7a774f65-eb86-4cb0-9805-e0988c11cded with Priority: HIGHEST for action port [ 667.067460] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_rules [ 667.067600] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_members [ 667.067695] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a774f65-eb86-4cb0-9805-e0988c11cded with Priority: HIGHEST for action port [ 667.067952] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.068391] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.068473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.068731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.068772] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.070586] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.070741] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.070816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.070998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.071454] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.071454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.071454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.072697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.072697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.072697] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.076020] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a774f65-eb86-4cb0-9805-e0988c11cded taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.076020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.076020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.076221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.076320] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a774f65-eb86-4cb0-9805-e0988c11cded',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.571435] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.571800] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.578605] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.583612] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a774f65-eb86-4cb0-9805-e0988c11cded with status ACTIVE [ 667.583840] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.583976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.584063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.584302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.584386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.584561] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.584671] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.584735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.584892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.584964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.585296] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.585451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.585580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.585790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.586023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.586023] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a774f65-eb86-4cb0-9805-e0988c11cded is going to be updated. [ 667.610430] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.610655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.610707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.611086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.611086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.611505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.084310] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.327215] env[65359]: INFO networking_nsxv3.common.synchronization [req-aa6aaae7-37f5-45c5-8088-aede7e37ad57 req-150359aa-5ad4-4653-879e-34d4d7a40acb tempest-FloatingIPsAssociationNegativeTestJSON-1657137340 tempest-FloatingIPsAssociationNegativeTestJSON-1657137340-project-member] Enqueued Resource ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd with Priority: HIGHEST for action security_group_members [ 668.328304] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd with Priority: HIGHEST for action security_group_members [ 668.329627] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.329772] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.329995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.330361] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.330662] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.330662] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.330790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.330949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.330949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.331103] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46b0db53-8bd6-4cc8-90b3-dd8299fa29cd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.587691] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.587918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.587918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.588511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.588511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.588511] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 703826e2-1d66-436e-9721-f997727e26c4 is going to be created. [ 668.628692] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.629025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.629025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.629179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.629680] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.644330] env[65359]: INFO networking_nsxv3.common.synchronization [None req-504c990e-9fe1-4c23-901f-16c3ca1b5525 None None] Enqueued Resource ID: cb0bd9b1-440e-494e-b13d-f4f2856d9435 with Priority: HIGHEST for action port [ 668.645573] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: UNINITIALIZED for 2s [ 668.645779] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb0bd9b1-440e-494e-b13d-f4f2856d9435 with Priority: HIGHEST for action port [ 668.646885] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb0bd9b1-440e-494e-b13d-f4f2856d9435 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.646885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb0bd9b1-440e-494e-b13d-f4f2856d9435" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.646885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb0bd9b1-440e-494e-b13d-f4f2856d9435" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.646885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb0bd9b1-440e-494e-b13d-f4f2856d9435" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.647097] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb0bd9b1-440e-494e-b13d-f4f2856d9435',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.708148] env[65359]: INFO networking_nsxv3.common.synchronization [None req-700d6ecd-b4f9-42e3-b639-35e311461e14 None None] Enqueued Resource ID: 8aa887b3-83c2-4313-8415-f01d49735726 with Priority: HIGHEST for action port [ 668.710767] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8aa887b3-83c2-4313-8415-f01d49735726 with Priority: HIGHEST for action port [ 668.710767] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-8aa887b3-83c2-4313-8415-f01d49735726 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.710767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8aa887b3-83c2-4313-8415-f01d49735726" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.710767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8aa887b3-83c2-4313-8415-f01d49735726" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.710767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8aa887b3-83c2-4313-8415-f01d49735726" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.710767] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8aa887b3-83c2-4313-8415-f01d49735726',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.833427] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.833609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.833678] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.833908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.833996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.834216] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.837569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.837569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.837569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.837569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.837711] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd already deleted. [ 668.837711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.150492] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb0bd9b1-440e-494e-b13d-f4f2856d9435 [ 669.150492] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.150492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.150492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.150492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.150707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.150707] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb0bd9b1-440e-494e-b13d-f4f2856d9435 already deleted. [ 669.150707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb0bd9b1-440e-494e-b13d-f4f2856d9435" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.214076] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8aa887b3-83c2-4313-8415-f01d49735726 [ 669.214076] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.214076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.214076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.215229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.215918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.215918] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8aa887b3-83c2-4313-8415-f01d49735726 already deleted. [ 669.215918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8aa887b3-83c2-4313-8415-f01d49735726" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.613240] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-5 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.617118] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.617118] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.617118] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.617118] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.617118] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.617118] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.617118] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.617118] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.617118] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.617118] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.617118] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.617118] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.617118] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.617118] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.617118] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.636966] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.636966] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.636966] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.636966] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.637177] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-b949d1b4-fc4f-4777-a4b6-06b6640489b8 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.637364] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-b949d1b4-fc4f-4777-a4b6-06b6640489b8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.637498] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-b949d1b4-fc4f-4777-a4b6-06b6640489b8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.637801] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-b949d1b4-fc4f-4777-a4b6-06b6640489b8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.638567] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b949d1b4-fc4f-4777-a4b6-06b6640489b8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.141969] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.142363] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.142581] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.143065] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.143211] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.143414] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port b949d1b4-fc4f-4777-a4b6-06b6640489b8 not found, creating... [ 670.143744] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.144052] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.144176] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.144477] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.144623] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.145468] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.145680] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.145848] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.146163] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.146425] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.146865] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: b949d1b4-fc4f-4777-a4b6-06b6640489b8 is going to be created. [ 670.171416] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.171868] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.172174] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.172858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.173105] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.173397] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-b949d1b4-fc4f-4777-a4b6-06b6640489b8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.657818] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: SUCCESS [ 670.658278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.658580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.658924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.659192] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.659303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.659392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.659738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.659882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.659962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.660094] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.717380] env[65359]: INFO networking_nsxv3.common.synchronization [None req-293bed56-ae5a-49b7-9706-5165f994d3b7 None None] Enqueued Resource ID: 112d3868-d85c-4a68-ac5d-be847783b090 with Priority: HIGHEST for action port [ 670.717937] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 112d3868-d85c-4a68-ac5d-be847783b090 with Priority: HIGHEST for action port [ 670.718264] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-112d3868-d85c-4a68-ac5d-be847783b090 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.718391] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-112d3868-d85c-4a68-ac5d-be847783b090" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.718438] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-112d3868-d85c-4a68-ac5d-be847783b090" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.718762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-112d3868-d85c-4a68-ac5d-be847783b090" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.718762] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('112d3868-d85c-4a68-ac5d-be847783b090',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.960995] env[65359]: INFO networking_nsxv3.common.synchronization [req-aa6aaae7-37f5-45c5-8088-aede7e37ad57 req-53dc5d69-ddb7-4eb0-b65a-98ebdd02f664 service nova] Enqueued Resource ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd with Priority: HIGHEST for action security_group_rules [ 670.963312] env[65359]: INFO networking_nsxv3.common.synchronization [req-aa6aaae7-37f5-45c5-8088-aede7e37ad57 req-53dc5d69-ddb7-4eb0-b65a-98ebdd02f664 service nova] Enqueued Resource ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd with Priority: HIGHEST for action security_group_members [ 670.963312] env[65359]: INFO networking_nsxv3.common.synchronization [req-aa6aaae7-37f5-45c5-8088-aede7e37ad57 req-53dc5d69-ddb7-4eb0-b65a-98ebdd02f664 service nova] Enqueued Resource ID: b949d1b4-fc4f-4777-a4b6-06b6640489b8 with Priority: HIGHEST for action port [ 670.963312] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd with Priority: HIGHEST for action security_group_rules [ 670.963312] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd with Priority: HIGHEST for action security_group_members [ 670.963312] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b949d1b4-fc4f-4777-a4b6-06b6640489b8 with Priority: HIGHEST for action port [ 670.963955] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.963955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.963955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.964602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.964602] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46b0db53-8bd6-4cc8-90b3-dd8299fa29cd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.965409] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.965545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.965608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.965782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.965927] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.966038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.966104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.966233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.966320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.966414] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46b0db53-8bd6-4cc8-90b3-dd8299fa29cd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.972036] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-b949d1b4-fc4f-4777-a4b6-06b6640489b8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.972036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b949d1b4-fc4f-4777-a4b6-06b6640489b8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.972036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b949d1b4-fc4f-4777-a4b6-06b6640489b8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.972036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b949d1b4-fc4f-4777-a4b6-06b6640489b8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.972036] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b949d1b4-fc4f-4777-a4b6-06b6640489b8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.162701] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.223945] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 112d3868-d85c-4a68-ac5d-be847783b090 [ 671.224924] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.224924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.224924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.224924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.224924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.224924] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:112d3868-d85c-4a68-ac5d-be847783b090 already deleted. [ 671.225311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-112d3868-d85c-4a68-ac5d-be847783b090" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.474615] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.474615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.474615] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46b0db53-8bd6-4cc8-90b3-dd8299fa29cd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.476930] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b949d1b4-fc4f-4777-a4b6-06b6640489b8 with status ACTIVE [ 671.476930] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.476930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.476930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.476930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.476930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.476930] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.476930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.481119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.481119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.481119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.481119] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.481119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.481119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.481119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.481119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.481119] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b949d1b4-fc4f-4777-a4b6-06b6640489b8 is going to be updated. [ 671.505878] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.506126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.506252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.506513] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.506661] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.506833] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b949d1b4-fc4f-4777-a4b6-06b6640489b8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.667369] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 703826e2-1d66-436e-9721-f997727e26c4: rpc.has_security_group_logging(os_id): False [ 671.698643] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.699783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.699852] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.700148] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.700277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.700633] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.700772] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.700839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.701115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.701230] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.701362] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 703826e2-1d66-436e-9721-f997727e26c4 is going to be created. [ 671.801144] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.801334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.801392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.802000] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.802000] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.818228] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: IN_PROGRESS for 2s [ 671.976338] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46b0db53-8bd6-4cc8-90b3-dd8299fa29cd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.194759] env[65359]: INFO networking_nsxv3.common.synchronization [None req-16e6cb3f-db0a-40ae-b45c-a573a9ee3722 None None] Enqueued Resource ID: b4da23cb-c81e-4b86-94e5-93ad1611025a with Priority: HIGHEST for action port [ 672.195153] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4da23cb-c81e-4b86-94e5-93ad1611025a with Priority: HIGHEST for action port [ 672.195745] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4da23cb-c81e-4b86-94e5-93ad1611025a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.195861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4da23cb-c81e-4b86-94e5-93ad1611025a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.195861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4da23cb-c81e-4b86-94e5-93ad1611025a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.197162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4da23cb-c81e-4b86-94e5-93ad1611025a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.197162] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4da23cb-c81e-4b86-94e5-93ad1611025a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.479129] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.479343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.479391] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.479852] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.479969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.480129] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd is going to be created. [ 672.516052] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.516052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.516052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.516052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.516052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.531685] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd in Status: UNINITIALIZED for 2s [ 672.542199] env[65359]: INFO networking_nsxv3.common.synchronization [None req-d989a741-e933-4b71-9806-e439234ddf93 None None] Enqueued Resource ID: 4d372880-3872-43d5-be49-ab747da210d6 with Priority: HIGHEST for action port [ 672.542480] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d372880-3872-43d5-be49-ab747da210d6 with Priority: HIGHEST for action port [ 672.543130] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d372880-3872-43d5-be49-ab747da210d6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.543500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d372880-3872-43d5-be49-ab747da210d6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.545207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d372880-3872-43d5-be49-ab747da210d6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.545207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d372880-3872-43d5-be49-ab747da210d6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.545207] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d372880-3872-43d5-be49-ab747da210d6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.699955] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4da23cb-c81e-4b86-94e5-93ad1611025a [ 672.700425] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.700425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.700783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.701341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.701453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.701726] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4da23cb-c81e-4b86-94e5-93ad1611025a already deleted. [ 672.701726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4da23cb-c81e-4b86-94e5-93ad1611025a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.048252] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d372880-3872-43d5-be49-ab747da210d6 [ 673.048252] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.048252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.048252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.049186] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.049186] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.049186] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d372880-3872-43d5-be49-ab747da210d6 already deleted. [ 673.049186] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d372880-3872-43d5-be49-ab747da210d6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.833974] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: SUCCESS [ 673.834266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.543098] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd in Status: SUCCESS [ 674.543385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.543634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.543937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.544240] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.544427] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.544535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.544770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.545403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.545500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.545650] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46b0db53-8bd6-4cc8-90b3-dd8299fa29cd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.872151] env[65359]: INFO networking_nsxv3.common.synchronization [None req-0cde3763-4050-4e2e-800e-b1ec9115b1c8 tempest-AttachVolumeShelveTestJSON-543762586 tempest-AttachVolumeShelveTestJSON-543762586-project-member] Enqueued Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_rules [ 674.872492] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_rules [ 674.873469] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.873469] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.873469] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.873469] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.873469] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.048643] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.049305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.049305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.049305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.049429] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.049493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.049555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.049780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.049873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.049930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.050104] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.050179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.050215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.050412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.050558] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.050902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.050902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.050902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.051083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.051083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.051146] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46b0db53-8bd6-4cc8-90b3-dd8299fa29cd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.163441] env[65359]: INFO networking_nsxv3.common.synchronization [None req-583f933a-bae3-423e-8e10-78599cc4c80a tempest-AttachVolumeShelveTestJSON-543762586 tempest-AttachVolumeShelveTestJSON-543762586-project-member] Enqueued Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_rules [ 675.164671] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_rules [ 675.165044] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.165161] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.396055] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.398243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.398243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.398243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.398243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.398243] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 already deleted. [ 675.398243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.398243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.398243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.398243] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.421515] env[65359]: INFO networking_nsxv3.common.synchronization [None req-9195dee3-8410-4f2a-ab35-c27eeb3aaab0 None None] Enqueued Resource ID: c3218a0b-76ff-4087-b19f-8847a350ba27 with Priority: HIGHEST for action port [ 675.421515] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3218a0b-76ff-4087-b19f-8847a350ba27 with Priority: HIGHEST for action port [ 675.421515] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3218a0b-76ff-4087-b19f-8847a350ba27 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.421515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3218a0b-76ff-4087-b19f-8847a350ba27" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.421767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3218a0b-76ff-4087-b19f-8847a350ba27" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.423760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3218a0b-76ff-4087-b19f-8847a350ba27" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.423760] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3218a0b-76ff-4087-b19f-8847a350ba27',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.554156] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd: rpc.has_security_group_logging(os_id): False [ 675.576692] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.576692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.576692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.576692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.576692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.576692] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.576692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.576692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.576692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.576692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.576692] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.576692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.576692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.576692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.576692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.577396] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.577396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.577787] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.578034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.578153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.578383] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd is going to be created. [ 675.642183] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.642392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.642392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.642616] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.642801] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.657537] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd in Status: IN_PROGRESS for 2s [ 675.924787] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.925253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.925253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.925253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.925387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.925426] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 already deleted. [ 675.925483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.925697] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3218a0b-76ff-4087-b19f-8847a350ba27 [ 675.925873] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.925995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.926069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.926202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.926266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.926356] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3218a0b-76ff-4087-b19f-8847a350ba27 already deleted. [ 675.926435] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3218a0b-76ff-4087-b19f-8847a350ba27" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.672342] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd in Status: SUCCESS [ 677.672342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.058095] env[65359]: INFO networking_nsxv3.common.synchronization [req-4fc3637b-3e67-4aff-b1bd-06aeb2c282f6 req-83700b83-4737-4d70-8b43-e31b0c845452 tempest-FloatingIPsAssociationTestJSON-809440522 tempest-FloatingIPsAssociationTestJSON-809440522-project-member] Enqueued Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_members [ 678.059477] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_members [ 678.059477] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.059477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.059477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.059985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.059985] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.059985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.059985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.060233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.060233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.060233] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.353522] env[65359]: INFO networking_nsxv3.common.synchronization [req-6ca496d9-cd72-44cc-bc92-bc5a7bdb3ef6 req-bfa3ce4e-57bb-44d3-a509-e2a985d1f690 tempest-ServersAdminTestJSON-387763736 tempest-ServersAdminTestJSON-387763736-project-member] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 678.354119] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 678.354398] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.354529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.354605] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.354796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.355174] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.355421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.355500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.355663] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.355767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.355851] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.563036] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.781791] env[65359]: INFO networking_nsxv3.common.synchronization [None req-c1592cea-d4bf-486d-b854-ebce34e49318 None None] Enqueued Resource ID: 4ca81940-b8c3-4279-b39c-14229da45dbf with Priority: HIGHEST for action port [ 678.782657] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca81940-b8c3-4279-b39c-14229da45dbf with Priority: HIGHEST for action port [ 678.783094] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ca81940-b8c3-4279-b39c-14229da45dbf taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.783094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ca81940-b8c3-4279-b39c-14229da45dbf" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.783224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ca81940-b8c3-4279-b39c-14229da45dbf" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.783751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ca81940-b8c3-4279-b39c-14229da45dbf" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.783751] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ca81940-b8c3-4279-b39c-14229da45dbf',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.854190] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-768 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.854190] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.854190] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.854445] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.854622] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.854761] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.854944] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.855241] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.855511] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.855588] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.855689] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.855787] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.855890] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.855992] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.856118] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.856245] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.857562] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.878479] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.878479] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 678.878479] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.878479] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-768" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.878479] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-97beea04-0cdc-4bf4-a460-f46a1c1bf430 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.878948] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-97beea04-0cdc-4bf4-a460-f46a1c1bf430" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.878948] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-97beea04-0cdc-4bf4-a460-f46a1c1bf430" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.879052] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-97beea04-0cdc-4bf4-a460-f46a1c1bf430" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.879137] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97beea04-0cdc-4bf4-a460-f46a1c1bf430',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.064491] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.286074] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ca81940-b8c3-4279-b39c-14229da45dbf [ 679.286074] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.286290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.286290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.286487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.286584] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.286679] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ca81940-b8c3-4279-b39c-14229da45dbf already deleted. [ 679.286759] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ca81940-b8c3-4279-b39c-14229da45dbf" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.360463] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.381615] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.381858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.382146] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.382310] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.382516] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.382721] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 97beea04-0cdc-4bf4-a460-f46a1c1bf430 not found, creating... [ 679.383131] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.383243] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.383358] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.383614] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.383762] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.384064] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.384217] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.384504] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.384573] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.384754] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.384887] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 97beea04-0cdc-4bf4-a460-f46a1c1bf430 is going to be created. [ 679.411116] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.411326] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.411473] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.411782] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.411997] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.412303] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-97beea04-0cdc-4bf4-a460-f46a1c1bf430" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.568041] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.568340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.568340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.568547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.568643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.568745] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6cbdd6f-4665-46af-8251-3803d47cff8b is going to be updated. [ 679.614056] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.614322] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.614392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.614650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.614798] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.626197] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6cbdd6f-4665-46af-8251-3803d47cff8b in Status: IN_PROGRESS for 2s [ 679.864076] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.864420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.864420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.864629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.864725] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.864851] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be updated. [ 679.897396] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.897570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.897618] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.897824] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.897961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.908884] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 680.196741] env[65359]: INFO networking_nsxv3.common.synchronization [req-6ca496d9-cd72-44cc-bc92-bc5a7bdb3ef6 req-7f8c3fc4-de4e-4279-bcd4-0cedb6822051 service nova] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_rules [ 680.196741] env[65359]: INFO networking_nsxv3.common.synchronization [req-6ca496d9-cd72-44cc-bc92-bc5a7bdb3ef6 req-7f8c3fc4-de4e-4279-bcd4-0cedb6822051 service nova] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 680.196741] env[65359]: INFO networking_nsxv3.common.synchronization [req-6ca496d9-cd72-44cc-bc92-bc5a7bdb3ef6 req-7f8c3fc4-de4e-4279-bcd4-0cedb6822051 service nova] Enqueued Resource ID: 97beea04-0cdc-4bf4-a460-f46a1c1bf430 with Priority: HIGHEST for action port [ 680.197462] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_rules [ 680.197734] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 680.197808] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97beea04-0cdc-4bf4-a460-f46a1c1bf430 with Priority: HIGHEST for action port [ 680.198108] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.198214] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.198276] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.199129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.199129] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.199604] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.199604] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.199782] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-97beea04-0cdc-4bf4-a460-f46a1c1bf430 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.199927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97beea04-0cdc-4bf4-a460-f46a1c1bf430" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.200110] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97beea04-0cdc-4bf4-a460-f46a1c1bf430" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.200352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97beea04-0cdc-4bf4-a460-f46a1c1bf430" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.200352] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97beea04-0cdc-4bf4-a460-f46a1c1bf430',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.702797] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.703308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.703308] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97beea04-0cdc-4bf4-a460-f46a1c1bf430 with status ACTIVE [ 680.703502] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.703633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.703766] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.703973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.704101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.704341] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.704461] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.704561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.704782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.704871] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.705080] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.705238] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.705313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.705504] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.705612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.705714] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97beea04-0cdc-4bf4-a460-f46a1c1bf430 is going to be updated. [ 680.728223] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.728405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.728512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.728789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.728956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.729426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97beea04-0cdc-4bf4-a460-f46a1c1bf430" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.974562] env[65359]: INFO networking_nsxv3.common.synchronization [None req-5fbb4303-5054-4567-a747-f516439854f2 None None] Enqueued Resource ID: c17e27fa-aeef-4e2e-98cd-c686a79b7325 with Priority: HIGHEST for action port [ 680.974562] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c17e27fa-aeef-4e2e-98cd-c686a79b7325 with Priority: HIGHEST for action port [ 680.974562] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-c17e27fa-aeef-4e2e-98cd-c686a79b7325 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.974562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c17e27fa-aeef-4e2e-98cd-c686a79b7325" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.974562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c17e27fa-aeef-4e2e-98cd-c686a79b7325" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.974562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c17e27fa-aeef-4e2e-98cd-c686a79b7325" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.974562] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c17e27fa-aeef-4e2e-98cd-c686a79b7325',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.479266] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c17e27fa-aeef-4e2e-98cd-c686a79b7325 [ 681.479266] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.479266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.479266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.479266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.479266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.479266] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c17e27fa-aeef-4e2e-98cd-c686a79b7325 already deleted. [ 681.479266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c17e27fa-aeef-4e2e-98cd-c686a79b7325" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.637490] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6cbdd6f-4665-46af-8251-3803d47cff8b in Status: SUCCESS [ 681.637870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.800951] env[65359]: INFO networking_nsxv3.common.synchronization [req-6dd0665c-48bd-4d17-b4ce-3127480db8be req-22552453-a04b-48dd-98d1-733fd7b744aa tempest-SecurityGroupRulesTestJSON-1992569406 tempest-SecurityGroupRulesTestJSON-1992569406-project-member] Enqueued Resource ID: 7fd3d426-36bb-47ba-bcc6-1bf3ae41bfbc with Priority: HIGHEST for action security_group_rules [ 681.801210] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fd3d426-36bb-47ba-bcc6-1bf3ae41bfbc with Priority: HIGHEST for action security_group_rules [ 681.801545] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fd3d426-36bb-47ba-bcc6-1bf3ae41bfbc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.801720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fd3d426-36bb-47ba-bcc6-1bf3ae41bfbc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.801796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fd3d426-36bb-47ba-bcc6-1bf3ae41bfbc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.802316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fd3d426-36bb-47ba-bcc6-1bf3ae41bfbc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.802316] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fd3d426-36bb-47ba-bcc6-1bf3ae41bfbc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.921357] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 681.921579] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.921748] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.921963] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.922176] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.922345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.922438] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.922615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.922696] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.922796] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.324738] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.325160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.325160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.325300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.325300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.325432] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fd3d426-36bb-47ba-bcc6-1bf3ae41bfbc already deleted. [ 682.325494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fd3d426-36bb-47ba-bcc6-1bf3ae41bfbc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.425160] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.542401] env[65359]: INFO networking_nsxv3.common.synchronization [None req-a0d86620-7ad5-4e87-8aa0-70af610a004b tempest-MigrationsAdminTest-860872539 tempest-MigrationsAdminTest-860872539-project-member] Enqueued Resource ID: 05257200-7205-4fd1-8746-67b76f51235c with Priority: HIGHEST for action security_group_rules [ 682.543472] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05257200-7205-4fd1-8746-67b76f51235c with Priority: HIGHEST for action security_group_rules [ 682.543888] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05257200-7205-4fd1-8746-67b76f51235c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.544028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05257200-7205-4fd1-8746-67b76f51235c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.544082] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05257200-7205-4fd1-8746-67b76f51235c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.544407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05257200-7205-4fd1-8746-67b76f51235c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.544491] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05257200-7205-4fd1-8746-67b76f51235c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.719095] env[65359]: INFO networking_nsxv3.common.synchronization [None req-ff009040-ccb1-453a-a8cd-9bc84de7a6e5 tempest-MigrationsAdminTest-860872539 tempest-MigrationsAdminTest-860872539-project-member] Enqueued Resource ID: 05257200-7205-4fd1-8746-67b76f51235c with Priority: HIGHEST for action security_group_rules [ 682.719095] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05257200-7205-4fd1-8746-67b76f51235c with Priority: HIGHEST for action security_group_rules [ 682.719095] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05257200-7205-4fd1-8746-67b76f51235c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.719095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05257200-7205-4fd1-8746-67b76f51235c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.927117] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.066828] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.067030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.067030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.067260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.067393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.067508] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05257200-7205-4fd1-8746-67b76f51235c already deleted. [ 683.067616] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05257200-7205-4fd1-8746-67b76f51235c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.067807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05257200-7205-4fd1-8746-67b76f51235c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.068046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05257200-7205-4fd1-8746-67b76f51235c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.068179] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05257200-7205-4fd1-8746-67b76f51235c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.084140] env[65359]: INFO networking_nsxv3.common.synchronization [None req-fa664a58-f249-492c-a366-b32596ceae3e None None] Enqueued Resource ID: 67548bb7-fb69-4fa5-afab-aa6a215cca4e with Priority: HIGHEST for action port [ 683.084886] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67548bb7-fb69-4fa5-afab-aa6a215cca4e with Priority: HIGHEST for action port [ 683.085875] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-67548bb7-fb69-4fa5-afab-aa6a215cca4e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.085997] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67548bb7-fb69-4fa5-afab-aa6a215cca4e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.086079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67548bb7-fb69-4fa5-afab-aa6a215cca4e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.086341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67548bb7-fb69-4fa5-afab-aa6a215cca4e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.086798] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67548bb7-fb69-4fa5-afab-aa6a215cca4e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.430509] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.431030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.431151] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.431935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.432063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.432172] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be updated. [ 683.461927] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.462098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.462218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.462377] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.462521] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.473345] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 683.589900] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67548bb7-fb69-4fa5-afab-aa6a215cca4e [ 683.590238] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.590412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.590578] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.590749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.590841] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.590935] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67548bb7-fb69-4fa5-afab-aa6a215cca4e already deleted. [ 683.592211] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67548bb7-fb69-4fa5-afab-aa6a215cca4e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.594046] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.594046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.594046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.594281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.594281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.594488] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05257200-7205-4fd1-8746-67b76f51235c already deleted. [ 683.594488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05257200-7205-4fd1-8746-67b76f51235c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.453910] env[65359]: INFO networking_nsxv3.common.synchronization [req-470364df-af68-4928-9b4b-410c82a0c74e req-dd04204e-c4a5-461f-b70c-f859cc8df844 tempest-ServerDiskConfigTestJSON-2085995032 tempest-ServerDiskConfigTestJSON-2085995032-project-member] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 685.455059] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 685.456564] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.456723] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.456723] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.457448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.457448] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.457448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.457448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.457915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.457915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.457915] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.487144] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 685.487144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.487144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.487569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.487569] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.487569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.487799] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.487799] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.487894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.487929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.488010] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.607329] env[65359]: INFO networking_nsxv3.common.synchronization [req-3b84dc52-3206-45d9-88ba-912366ddad8a req-10073925-e092-42f9-ace0-5b65c1fca406 tempest-ListServersNegativeTestJSON-2074596717 tempest-ListServersNegativeTestJSON-2074596717-project-member] Enqueued Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 685.607863] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 685.608384] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.608492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.608492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.608717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.608870] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.608973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.609042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.609199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.609284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.609378] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.965216] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.965506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.965506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.965756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.965854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.966077] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.966174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.966247] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.966477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.966477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.966632] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be updated. [ 685.990661] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.990661] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.990826] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.990948] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.991100] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.992046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.992046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.992046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.992046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.992046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.992046] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.992046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.992046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.992535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.992535] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.992535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.992535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.992682] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.992682] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.992759] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.992796] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.011594] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.011847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.011847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.012150] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.012317] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.025963] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: IN_PROGRESS for 2s [ 686.088341] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-980 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.088562] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-980" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.088726] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-980" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.089078] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-980" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.089363] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.089521] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.089669] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.089893] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.090046] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.090268] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.090373] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.090512] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.090645] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.090827] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.090947] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.091114] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.113687] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.113898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.113985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.114294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.114465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.114765] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.114910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.114984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.115276] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.115383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.115648] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a4df49-7816-4678-be36-250c471235e3 already deleted. [ 686.115648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.124531] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.124798] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 686.125059] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.125381] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-980" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.125801] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-033a9388-6838-4ee0-ab78-460fb0bbf924 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.126065] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-033a9388-6838-4ee0-ab78-460fb0bbf924" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.126236] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-033a9388-6838-4ee0-ab78-460fb0bbf924" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.126633] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-033a9388-6838-4ee0-ab78-460fb0bbf924" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.126891] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('033a9388-6838-4ee0-ab78-460fb0bbf924',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.283878] env[65359]: INFO networking_nsxv3.common.synchronization [None req-b85d0ffc-3442-4b03-8bfc-f50af698303e None None] Enqueued Resource ID: b718fa2a-48d5-4275-8515-a447a32da01a with Priority: HIGHEST for action port [ 686.284484] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b718fa2a-48d5-4275-8515-a447a32da01a with Priority: HIGHEST for action port [ 686.285021] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-b718fa2a-48d5-4275-8515-a447a32da01a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.285171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b718fa2a-48d5-4275-8515-a447a32da01a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.285236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b718fa2a-48d5-4275-8515-a447a32da01a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.285528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b718fa2a-48d5-4275-8515-a447a32da01a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.285726] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b718fa2a-48d5-4275-8515-a447a32da01a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.498156] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6eb7ac19-945a-427f-84cb-cc4a488527fc: rpc.has_security_group_logging(os_id): False [ 686.527823] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.528331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.528331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.529545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.529545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.529545] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.529545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.529545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.529545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.529545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.529894] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.529894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.529974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.530526] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.530643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.530863] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.530957] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.531042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.531633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.531711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.531885] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be updated. [ 686.631185] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.631413] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.631532] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.632102] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.632102] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.632253] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 033a9388-6838-4ee0-ab78-460fb0bbf924 not found, creating... [ 686.632590] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.632818] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.632818] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.633162] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.633306] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.633968] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.633968] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.633968] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.634261] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.634409] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.634580] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 033a9388-6838-4ee0-ab78-460fb0bbf924 is going to be created. [ 686.645721] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.646019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.646019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.646247] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.646390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.683203] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 686.690305] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.690599] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.690780] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.691094] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.691327] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.691647] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-033a9388-6838-4ee0-ab78-460fb0bbf924" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.787640] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b718fa2a-48d5-4275-8515-a447a32da01a [ 686.787973] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.788202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.788202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.788414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.788524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.789179] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b718fa2a-48d5-4275-8515-a447a32da01a already deleted. [ 686.789179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b718fa2a-48d5-4275-8515-a447a32da01a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.350769] env[65359]: INFO networking_nsxv3.common.synchronization [req-3b84dc52-3206-45d9-88ba-912366ddad8a req-08f49496-90d3-4749-bc43-46dfee0d4ea0 service nova] Enqueued Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_rules [ 687.350954] env[65359]: INFO networking_nsxv3.common.synchronization [req-3b84dc52-3206-45d9-88ba-912366ddad8a req-08f49496-90d3-4749-bc43-46dfee0d4ea0 service nova] Enqueued Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 687.351236] env[65359]: INFO networking_nsxv3.common.synchronization [req-3b84dc52-3206-45d9-88ba-912366ddad8a req-08f49496-90d3-4749-bc43-46dfee0d4ea0 service nova] Enqueued Resource ID: 033a9388-6838-4ee0-ab78-460fb0bbf924 with Priority: HIGHEST for action port [ 687.352353] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_rules [ 687.352458] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 687.352638] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 033a9388-6838-4ee0-ab78-460fb0bbf924 with Priority: HIGHEST for action port [ 687.353060] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.353215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.353257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.353507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.353587] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.354380] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.354490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.354562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.354732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.354872] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.354965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.355035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.355173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.355292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.355352] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.356800] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-033a9388-6838-4ee0-ab78-460fb0bbf924 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.356941] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-033a9388-6838-4ee0-ab78-460fb0bbf924" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.357049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-033a9388-6838-4ee0-ab78-460fb0bbf924" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.357291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-033a9388-6838-4ee0-ab78-460fb0bbf924" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.357355] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('033a9388-6838-4ee0-ab78-460fb0bbf924',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.787444] env[65359]: INFO networking_nsxv3.common.synchronization [req-c887638d-6623-4e52-8b8a-7c9e55dece2e req-b24d3a53-da95-4daa-8408-b4870756fb54 tempest-DeleteServersAdminTestJSON-1164442439 tempest-DeleteServersAdminTestJSON-1164442439-project-member] Enqueued Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_members [ 687.787444] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 with Priority: HIGHEST for action security_group_members [ 687.788328] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c01e6ff-b831-4d21-8c9a-e3a067190d76 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.788328] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.788328] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.791335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.791557] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.791684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.791752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.791954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.792057] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.792162] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c01e6ff-b831-4d21-8c9a-e3a067190d76',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.859274] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.859274] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.860697] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.861766] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 033a9388-6838-4ee0-ab78-460fb0bbf924 with status ACTIVE [ 687.861969] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.862105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.862171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.862378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.862468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.862645] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.862744] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.862807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.862973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.863131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.863489] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.863489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.863489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.863727] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.863727] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.863842] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 033a9388-6838-4ee0-ab78-460fb0bbf924 is going to be updated. [ 687.887763] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.887910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.887976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.888230] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.888398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.888569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-033a9388-6838-4ee0-ab78-460fb0bbf924" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.037302] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 688.037555] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b deletion is rescheduled due to dependency. [ 688.037693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.127517] env[65359]: INFO networking_nsxv3.common.synchronization [req-3b84dc52-3206-45d9-88ba-912366ddad8a req-739c10f9-65be-4ec2-9185-68b390f5669c tempest-ListServersNegativeTestJSON-2074596717 tempest-ListServersNegativeTestJSON-2074596717-project-member] Enqueued Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 688.127779] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 688.128502] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.128684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.295969] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.296253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.296361] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.296606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.296709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.296970] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.297086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.297178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.297357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.297436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.297490] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 is going to be updated. [ 688.329933] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.330109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.330877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.330877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.330877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.341382] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 in Status: IN_PROGRESS for 2s [ 688.366227] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.702552] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 688.702902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.870216] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.870216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.870216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.870216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.870216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.870216] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a4df49-7816-4678-be36-250c471235e3 is going to be created. [ 688.898237] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.898458] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.898522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.898982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.898982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.910851] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: UNINITIALIZED for 2s [ 689.080558] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-980 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.080843] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-980" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.080984] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-980" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.081510] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-980" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.081798] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.081953] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.082082] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.082449] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.082516] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.082716] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.082821] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.082919] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.083031] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.083137] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.083221] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.083354] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.104065] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.104341] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 689.104436] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.104610] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-980" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.104931] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-1969a773-734d-46cd-b613-dc78cb167dfb taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.105109] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-1969a773-734d-46cd-b613-dc78cb167dfb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.105219] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-1969a773-734d-46cd-b613-dc78cb167dfb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.106959] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-1969a773-734d-46cd-b613-dc78cb167dfb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.107096] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1969a773-734d-46cd-b613-dc78cb167dfb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.459910] env[65359]: INFO networking_nsxv3.common.synchronization [None req-26683582-d34d-4a74-8c1f-5b9d4dfb0c59 None None] Enqueued Resource ID: 6f27c8f6-67bf-450c-8f99-d3deb4409bb2 with Priority: HIGHEST for action port [ 689.460599] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f27c8f6-67bf-450c-8f99-d3deb4409bb2 with Priority: HIGHEST for action port [ 689.460599] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f27c8f6-67bf-450c-8f99-d3deb4409bb2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.461016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f27c8f6-67bf-450c-8f99-d3deb4409bb2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.461152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f27c8f6-67bf-450c-8f99-d3deb4409bb2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.461452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f27c8f6-67bf-450c-8f99-d3deb4409bb2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.461547] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f27c8f6-67bf-450c-8f99-d3deb4409bb2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.610052] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.610393] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.610550] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.610776] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.610931] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.611098] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 1969a773-734d-46cd-b613-dc78cb167dfb not found, creating... [ 689.611366] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.612070] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.612301] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.612514] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.613128] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.613446] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.613607] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.613721] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.613947] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.614282] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.614448] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 1969a773-734d-46cd-b613-dc78cb167dfb is going to be created. [ 689.639700] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.639700] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.639938] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.640140] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.640321] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.641022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-1969a773-734d-46cd-b613-dc78cb167dfb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.965392] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f27c8f6-67bf-450c-8f99-d3deb4409bb2 [ 689.965392] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.965392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.965392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.965392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.965392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.965977] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f27c8f6-67bf-450c-8f99-d3deb4409bb2 already deleted. [ 689.965977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f27c8f6-67bf-450c-8f99-d3deb4409bb2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.354709] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 in Status: SUCCESS [ 690.354709] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c01e6ff-b831-4d21-8c9a-e3a067190d76 deletion is rescheduled due to dependency. [ 690.354709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c01e6ff-b831-4d21-8c9a-e3a067190d76" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.400068] env[65359]: INFO networking_nsxv3.common.synchronization [req-3b84dc52-3206-45d9-88ba-912366ddad8a req-84009fd8-50f2-475d-b593-5520ec41662e service nova] Enqueued Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_rules [ 690.400068] env[65359]: INFO networking_nsxv3.common.synchronization [req-3b84dc52-3206-45d9-88ba-912366ddad8a req-84009fd8-50f2-475d-b593-5520ec41662e service nova] Enqueued Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 690.400068] env[65359]: INFO networking_nsxv3.common.synchronization [req-3b84dc52-3206-45d9-88ba-912366ddad8a req-84009fd8-50f2-475d-b593-5520ec41662e service nova] Enqueued Resource ID: 1969a773-734d-46cd-b613-dc78cb167dfb with Priority: HIGHEST for action port [ 690.400068] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_rules [ 690.400068] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 690.400068] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1969a773-734d-46cd-b613-dc78cb167dfb with Priority: HIGHEST for action port [ 690.400068] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.400068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.400068] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.400068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.400964] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-1969a773-734d-46cd-b613-dc78cb167dfb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.401324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1969a773-734d-46cd-b613-dc78cb167dfb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.401546] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1969a773-734d-46cd-b613-dc78cb167dfb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.401904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1969a773-734d-46cd-b613-dc78cb167dfb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.402179] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1969a773-734d-46cd-b613-dc78cb167dfb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.600707] env[65359]: INFO networking_nsxv3.common.synchronization [req-3b84dc52-3206-45d9-88ba-912366ddad8a req-d56332f6-3798-40d7-8d49-235f4ab3ad6c tempest-ListServersNegativeTestJSON-2074596717 tempest-ListServersNegativeTestJSON-2074596717-project-member] Enqueued Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 690.601442] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 690.604313] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.604736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.904923] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1969a773-734d-46cd-b613-dc78cb167dfb with status ACTIVE [ 690.905063] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.905181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.905246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.905460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.905738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.905813] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.905893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.905964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.906203] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.911246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.911496] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.911657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.911708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.911904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.911962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.912064] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1969a773-734d-46cd-b613-dc78cb167dfb is going to be updated. [ 690.924367] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: SUCCESS [ 690.925125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.925125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.925125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.925311] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.925442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.925536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.925745] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.925854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.925973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.926101] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.927284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.927483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.927670] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.927782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.927844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.927994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.928073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.928162] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.940324] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.940324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.940611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.940653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.940793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.940961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1969a773-734d-46cd-b613-dc78cb167dfb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.006395] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-980 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.007139] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-980" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.007139] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-980" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.007139] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-980" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.007139] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.007322] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.008050] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.008050] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.008198] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.009565] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.009565] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.009565] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.009565] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.009565] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.009565] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.009565] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.043563] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.043563] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 691.043563] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.043849] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-980" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.044116] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-92f7a104-7e7b-427d-ae86-cd0ac1a55e2e taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.044296] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-92f7a104-7e7b-427d-ae86-cd0ac1a55e2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.044412] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-92f7a104-7e7b-427d-ae86-cd0ac1a55e2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.045032] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-92f7a104-7e7b-427d-ae86-cd0ac1a55e2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.045508] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92f7a104-7e7b-427d-ae86-cd0ac1a55e2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.430720] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.430720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.430720] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.461591] env[65359]: INFO networking_nsxv3.common.synchronization [None req-c62006bc-8947-4ebd-a541-31f1f4350ad9 None None] Enqueued Resource ID: 88f39f59-c99a-4085-a228-989305e63f34 with Priority: HIGHEST for action port [ 691.462562] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88f39f59-c99a-4085-a228-989305e63f34 with Priority: HIGHEST for action port [ 691.463306] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-88f39f59-c99a-4085-a228-989305e63f34 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.463306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88f39f59-c99a-4085-a228-989305e63f34" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.463306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88f39f59-c99a-4085-a228-989305e63f34" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.464952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88f39f59-c99a-4085-a228-989305e63f34" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.464952] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88f39f59-c99a-4085-a228-989305e63f34',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.551024] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.551024] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.551024] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.551024] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.551024] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.551024] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 92f7a104-7e7b-427d-ae86-cd0ac1a55e2e not found, creating... [ 691.551024] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.551024] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.551024] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.551024] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.551024] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.551745] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.552099] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.552406] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.552740] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.554468] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.554468] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 92f7a104-7e7b-427d-ae86-cd0ac1a55e2e is going to be created. [ 691.576360] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.578182] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.578182] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.578182] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.578182] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.578583] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-92f7a104-7e7b-427d-ae86-cd0ac1a55e2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.755864] env[65359]: INFO networking_nsxv3.common.synchronization [req-95c1bd54-a602-40f5-9f96-32d2558fa8b9 req-88c28263-8508-46e5-b02e-1d36384140e7 tempest-SecurityGroupRulesTestJSON-1992569406 tempest-SecurityGroupRulesTestJSON-1992569406-project-member] Enqueued Resource ID: 906e70bb-3269-41f3-be13-96fde7c0a40b with Priority: HIGHEST for action security_group_rules [ 691.756563] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 906e70bb-3269-41f3-be13-96fde7c0a40b with Priority: HIGHEST for action security_group_rules [ 691.756924] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-906e70bb-3269-41f3-be13-96fde7c0a40b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.757103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-906e70bb-3269-41f3-be13-96fde7c0a40b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.757209] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-906e70bb-3269-41f3-be13-96fde7c0a40b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.757504] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-906e70bb-3269-41f3-be13-96fde7c0a40b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.757639] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('906e70bb-3269-41f3-be13-96fde7c0a40b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.933434] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.967362] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88f39f59-c99a-4085-a228-989305e63f34 [ 691.967362] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.967718] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.967718] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.967906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.967994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.968079] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88f39f59-c99a-4085-a228-989305e63f34 already deleted. [ 691.968181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88f39f59-c99a-4085-a228-989305e63f34" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.284378] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.284378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.284378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.284378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.284378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.284378] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 906e70bb-3269-41f3-be13-96fde7c0a40b already deleted. [ 692.284378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-906e70bb-3269-41f3-be13-96fde7c0a40b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.366681] env[65359]: INFO networking_nsxv3.common.synchronization [req-3b84dc52-3206-45d9-88ba-912366ddad8a req-d0409f91-a34f-4d81-a579-a04d70af4b85 service nova] Enqueued Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_rules [ 692.366681] env[65359]: INFO networking_nsxv3.common.synchronization [req-3b84dc52-3206-45d9-88ba-912366ddad8a req-d0409f91-a34f-4d81-a579-a04d70af4b85 service nova] Enqueued Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 692.366681] env[65359]: INFO networking_nsxv3.common.synchronization [req-3b84dc52-3206-45d9-88ba-912366ddad8a req-d0409f91-a34f-4d81-a579-a04d70af4b85 service nova] Enqueued Resource ID: 92f7a104-7e7b-427d-ae86-cd0ac1a55e2e with Priority: HIGHEST for action port [ 692.366919] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_rules [ 692.366983] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 692.367615] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92f7a104-7e7b-427d-ae86-cd0ac1a55e2e with Priority: HIGHEST for action port [ 692.367803] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.367803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.368056] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.368277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.368552] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-92f7a104-7e7b-427d-ae86-cd0ac1a55e2e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.368672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92f7a104-7e7b-427d-ae86-cd0ac1a55e2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.368737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92f7a104-7e7b-427d-ae86-cd0ac1a55e2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.368948] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92f7a104-7e7b-427d-ae86-cd0ac1a55e2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.370527] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92f7a104-7e7b-427d-ae86-cd0ac1a55e2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.435452] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.435666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.435712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.435919] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.436037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.436172] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a4df49-7816-4678-be36-250c471235e3 is going to be updated. [ 692.470965] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.471143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.471195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.471409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.471565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.483179] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: IN_PROGRESS for 2s [ 692.873036] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92f7a104-7e7b-427d-ae86-cd0ac1a55e2e with status ACTIVE [ 692.873036] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.873036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.873036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.873036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.873036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.873036] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.873036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.873036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.873687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.873687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.873687] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.873687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.873687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.873900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.873900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.873986] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92f7a104-7e7b-427d-ae86-cd0ac1a55e2e is going to be updated. [ 692.897991] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.898268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.898327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.898668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.898898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.899174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92f7a104-7e7b-427d-ae86-cd0ac1a55e2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.499531] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: SUCCESS [ 694.499531] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.500229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.501044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.501372] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.501599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.501784] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.502033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.502171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.502374] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.820441] env[65359]: INFO networking_nsxv3.common.synchronization [req-78636712-c6df-4528-8e31-254205e79d46 req-9e8e865d-fdfc-4696-bb31-556e63047ad3 tempest-DeleteServersTestJSON-2065668722 tempest-DeleteServersTestJSON-2065668722-project-member] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 694.821149] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 694.821467] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.821593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.821682] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.822137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.822306] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.822421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.822511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.822703] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.822793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.822907] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.006459] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.327378] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.327378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.327378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.327378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.327378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.327378] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.327378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.327378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.327378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.327648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.327648] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb already deleted. [ 695.327648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.351104] env[65359]: INFO networking_nsxv3.common.synchronization [req-29a5b259-7c14-4fa2-9622-271d9719c3eb req-27ecf89f-1893-4ec9-9614-a43975de1e12 tempest-ServersV294TestFqdnHostnames-1989972449 tempest-ServersV294TestFqdnHostnames-1989972449-project-member] Enqueued Resource ID: 7a31eada-fa66-45f2-8fea-2e11279344df with Priority: HIGHEST for action security_group_members [ 695.352650] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a31eada-fa66-45f2-8fea-2e11279344df with Priority: HIGHEST for action security_group_members [ 695.353082] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a31eada-fa66-45f2-8fea-2e11279344df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.353205] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.353274] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.353501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.353919] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.353919] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.353919] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.354111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.354471] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.354471] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a31eada-fa66-45f2-8fea-2e11279344df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.456387] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-125 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.456581] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.456700] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.457041] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.457305] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.457455] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.457566] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.457774] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.457911] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.458118] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.458225] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.458326] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.458470] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.458614] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.458739] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.458865] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.479289] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.479453] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 695.479616] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.480175] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.480302] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-a067ff4c-72f0-4b19-9fe7-e05dd2d1323b taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.480483] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-a067ff4c-72f0-4b19-9fe7-e05dd2d1323b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.480740] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-a067ff4c-72f0-4b19-9fe7-e05dd2d1323b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.481132] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-a067ff4c-72f0-4b19-9fe7-e05dd2d1323b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.481268] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a067ff4c-72f0-4b19-9fe7-e05dd2d1323b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.507693] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.858121] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.858337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.858422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.858735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.858840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.859096] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.859191] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.859280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.859605] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.859605] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.859605] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a31eada-fa66-45f2-8fea-2e11279344df is going to be updated. [ 695.886820] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.886974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.887059] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.887277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.887427] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.897176] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a31eada-fa66-45f2-8fea-2e11279344df in Status: IN_PROGRESS for 2s [ 695.985563] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.985814] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.985934] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.986250] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.986395] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.986560] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port a067ff4c-72f0-4b19-9fe7-e05dd2d1323b not found, creating... [ 695.986846] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.986998] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.987121] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.987348] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.987481] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.987786] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.987969] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.989372] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.989633] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.989874] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.990047] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: a067ff4c-72f0-4b19-9fe7-e05dd2d1323b is going to be created. [ 696.009459] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.009636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.009719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.009942] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.010052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.010142] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a4df49-7816-4678-be36-250c471235e3 is going to be updated. [ 696.012518] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.012922] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.012922] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.013233] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.013422] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.014065] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-a067ff4c-72f0-4b19-9fe7-e05dd2d1323b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.047465] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.047944] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.047944] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.048106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.048151] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.058126] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: IN_PROGRESS for 2s [ 696.756899] env[65359]: INFO networking_nsxv3.common.synchronization [req-78636712-c6df-4528-8e31-254205e79d46 req-9af66a3f-19f3-407e-a434-a355adc5b52e service nova] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_rules [ 696.757274] env[65359]: INFO networking_nsxv3.common.synchronization [req-78636712-c6df-4528-8e31-254205e79d46 req-9af66a3f-19f3-407e-a434-a355adc5b52e service nova] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 696.757274] env[65359]: INFO networking_nsxv3.common.synchronization [req-78636712-c6df-4528-8e31-254205e79d46 req-9af66a3f-19f3-407e-a434-a355adc5b52e service nova] Enqueued Resource ID: a067ff4c-72f0-4b19-9fe7-e05dd2d1323b with Priority: HIGHEST for action port [ 696.757828] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_rules [ 696.757961] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 696.758101] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a067ff4c-72f0-4b19-9fe7-e05dd2d1323b with Priority: HIGHEST for action port [ 696.758505] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.758664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.758776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.759073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.759179] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.760232] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.760486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.760486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.760615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.761751] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.761751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.761751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.761751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.761751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.761751] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.763903] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-a067ff4c-72f0-4b19-9fe7-e05dd2d1323b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.764034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a067ff4c-72f0-4b19-9fe7-e05dd2d1323b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.764075] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a067ff4c-72f0-4b19-9fe7-e05dd2d1323b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.764279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a067ff4c-72f0-4b19-9fe7-e05dd2d1323b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.764367] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a067ff4c-72f0-4b19-9fe7-e05dd2d1323b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.269446] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.269446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.269446] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.269446] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a067ff4c-72f0-4b19-9fe7-e05dd2d1323b with status ACTIVE [ 697.269446] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.269446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.269446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.269446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.269446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.269446] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.269446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.269446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.269446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.270313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.272939] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.272939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.272939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.272939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.272939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.272939] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a067ff4c-72f0-4b19-9fe7-e05dd2d1323b is going to be updated. [ 697.301589] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.301589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.301589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.301589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.301589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.301589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a067ff4c-72f0-4b19-9fe7-e05dd2d1323b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.773859] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.910489] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a31eada-fa66-45f2-8fea-2e11279344df in Status: SUCCESS [ 697.910954] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a31eada-fa66-45f2-8fea-2e11279344df deletion is rescheduled due to dependency. [ 697.911606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.071672] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: SUCCESS [ 698.071959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.072217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.072469] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.072738] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.072947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.072947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.073134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.073217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.073317] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.276307] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.276450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.276544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.276738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.276830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.276939] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be created. [ 698.302246] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.302435] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.302494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.302683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.302838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.312663] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: UNINITIALIZED for 2s [ 698.578462] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.922548] env[65359]: INFO networking_nsxv3.common.synchronization [None req-ddcf54c2-c9e2-46f9-a881-d7a4b2209bc8 None None] Enqueued Resource ID: 1be38e73-51fa-4bc9-aadd-e0e47ad1ffea with Priority: HIGHEST for action port [ 698.922792] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1be38e73-51fa-4bc9-aadd-e0e47ad1ffea with Priority: HIGHEST for action port [ 698.922976] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-1be38e73-51fa-4bc9-aadd-e0e47ad1ffea taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.923820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1be38e73-51fa-4bc9-aadd-e0e47ad1ffea" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.924185] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1be38e73-51fa-4bc9-aadd-e0e47ad1ffea" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.924185] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1be38e73-51fa-4bc9-aadd-e0e47ad1ffea" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.924332] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be38e73-51fa-4bc9-aadd-e0e47ad1ffea',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.081359] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.426739] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1be38e73-51fa-4bc9-aadd-e0e47ad1ffea [ 699.427369] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.427369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.427369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.427536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.427643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.427745] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1be38e73-51fa-4bc9-aadd-e0e47ad1ffea already deleted. [ 699.427829] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1be38e73-51fa-4bc9-aadd-e0e47ad1ffea" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.588750] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.588995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.589125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.589397] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.589511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.589625] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a4df49-7816-4678-be36-250c471235e3 is going to be updated. [ 699.634681] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.634681] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.634681] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.634681] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.634681] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.645457] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: IN_PROGRESS for 2s [ 699.843784] env[65359]: INFO networking_nsxv3.common.synchronization [req-ee53bc48-d8f2-4794-bc78-a619f3e5cfdc req-bb418235-d8ff-47b3-ae7e-ad7b14375302 tempest-AttachVolumeShelveTestJSON-543762586 tempest-AttachVolumeShelveTestJSON-543762586-project-member] Enqueued Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_members [ 699.843784] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_members [ 699.843784] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.843994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.843994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.844192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.844374] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.844490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.844556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.845445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.845445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.845445] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.326204] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 700.326790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.326790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.327126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.327517] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.327718] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.327833] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.328089] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.328183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.328274] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.328374] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.347438] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.347653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.347775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.348102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.348217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.348425] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.348560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.348606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.348737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.348814] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.348899] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 already deleted. [ 700.348979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.515502] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-124 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.515502] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.515502] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.515502] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.515502] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.515502] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.515989] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.516378] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.516626] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.516970] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.517215] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.517476] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.518369] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.518369] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.518369] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.518369] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.543469] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.543649] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 700.543780] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.543958] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.544292] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-4363feb5-a604-41f5-bfcc-d44e8fdaf970 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.544499] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.544581] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.544870] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.544999] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4363feb5-a604-41f5-bfcc-d44e8fdaf970',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.831026] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.831026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.831026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.831273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.831273] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.831365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.831428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.831587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.831672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.831794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.831982] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.832088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.832146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.832970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.832970] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.832970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.832970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.832970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.832970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.832970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.834803] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.048656] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.049012] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.049157] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.049469] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.049579] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.049727] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 4363feb5-a604-41f5-bfcc-d44e8fdaf970 not found, creating... [ 701.050010] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.050165] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.050354] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.050481] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.050634] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.053016] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.053290] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.053464] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.053775] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.053987] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.054174] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 4363feb5-a604-41f5-bfcc-d44e8fdaf970 is going to be created. [ 701.078619] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.078858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.079047] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.079310] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.079564] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.079798] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.336701] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6b655ed-9de5-4842-96d3-3652c9e45ddb: rpc.has_security_group_logging(os_id): False [ 701.364722] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.364939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.365108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.365519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.365519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.365756] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.365756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.365937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.366068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.366130] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.366316] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.366445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.366494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.366712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.367370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.367370] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.367370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.367370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.367370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.367581] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.367581] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be created. [ 701.460888] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.460888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.460888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.460888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.460888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.484166] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 701.630448] env[65359]: INFO networking_nsxv3.common.synchronization [None req-f9429b6d-ba27-4533-959d-e69ebd3dcc49 None None] Enqueued Resource ID: 35cfafe9-2ccd-4369-a89e-4ef63ab02a3d with Priority: HIGHEST for action port [ 701.630891] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35cfafe9-2ccd-4369-a89e-4ef63ab02a3d with Priority: HIGHEST for action port [ 701.631378] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-35cfafe9-2ccd-4369-a89e-4ef63ab02a3d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.631510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35cfafe9-2ccd-4369-a89e-4ef63ab02a3d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.631579] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35cfafe9-2ccd-4369-a89e-4ef63ab02a3d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.631845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35cfafe9-2ccd-4369-a89e-4ef63ab02a3d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.631932] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35cfafe9-2ccd-4369-a89e-4ef63ab02a3d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.661246] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: SUCCESS [ 701.662450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.662867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.663156] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.663685] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.663838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.663911] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.664135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.664227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.664316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.664496] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.664575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.664637] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.664785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.664939] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.665044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.665108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.665246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.665323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.665416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.665503] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.666773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.666946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.667319] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.667447] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.667535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.667691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.667778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.667876] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.859422] env[65359]: INFO networking_nsxv3.common.synchronization [req-ee53bc48-d8f2-4794-bc78-a619f3e5cfdc req-ff0f6be6-7079-4c3d-ae52-b6e6e3c9a82a service nova] Enqueued Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_rules [ 701.859667] env[65359]: INFO networking_nsxv3.common.synchronization [req-ee53bc48-d8f2-4794-bc78-a619f3e5cfdc req-ff0f6be6-7079-4c3d-ae52-b6e6e3c9a82a service nova] Enqueued Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_members [ 701.859732] env[65359]: INFO networking_nsxv3.common.synchronization [req-ee53bc48-d8f2-4794-bc78-a619f3e5cfdc req-ff0f6be6-7079-4c3d-ae52-b6e6e3c9a82a service nova] Enqueued Resource ID: 4363feb5-a604-41f5-bfcc-d44e8fdaf970 with Priority: HIGHEST for action port [ 701.860294] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_rules [ 701.860707] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_members [ 701.860907] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4363feb5-a604-41f5-bfcc-d44e8fdaf970 with Priority: HIGHEST for action port [ 701.861232] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.861364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.861467] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.861618] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.861749] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.862996] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.863153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.863283] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.863475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.863628] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.863757] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.863896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.864061] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.864196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.864286] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.865333] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-4363feb5-a604-41f5-bfcc-d44e8fdaf970 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.868446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.868576] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.868772] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.868884] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4363feb5-a604-41f5-bfcc-d44e8fdaf970',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.134130] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35cfafe9-2ccd-4369-a89e-4ef63ab02a3d [ 702.134456] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.134605] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.134704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.134938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.135045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.135146] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35cfafe9-2ccd-4369-a89e-4ef63ab02a3d already deleted. [ 702.135244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35cfafe9-2ccd-4369-a89e-4ef63ab02a3d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.171329] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43a4df49-7816-4678-be36-250c471235e3: rpc.has_security_group_logging(os_id): False [ 702.172644] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.194952] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.194952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.194952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.194952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.194952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.195192] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.195192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.195276] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.195379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.195456] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.195635] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.195732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.195795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.198866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.198866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.198866] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.198866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.198866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.198866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.198866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.198866] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43a4df49-7816-4678-be36-250c471235e3 is going to be created. [ 702.260577] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.260969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.261102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.261425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.261763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.275496] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: IN_PROGRESS for 2s [ 702.370579] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.372041] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.372041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.372198] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4363feb5-a604-41f5-bfcc-d44e8fdaf970 with status ACTIVE [ 702.372329] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.372463] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.372551] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.373634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.373634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.373634] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.373634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.373634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.373634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.373634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.373886] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.373995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.374080] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.374226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.374299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.374382] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4363feb5-a604-41f5-bfcc-d44e8fdaf970 is going to be updated. [ 702.403053] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.403053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.403053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.403053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.403053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.403291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.562193] env[65359]: INFO networking_nsxv3.common.synchronization [req-a522a999-bf75-4b80-bafe-58e5b05cf419 req-799c260b-3ca7-4b6c-9e86-c3fbaf15948f tempest-ServersAdminNegativeTestJSON-660584843 tempest-ServersAdminNegativeTestJSON-660584843-project-member] Enqueued Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_members [ 702.562787] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_members [ 702.566016] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-582cfc14-9eeb-4704-a95a-052a5b40435e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.566016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.566016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.566016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.566016] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.566016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.566016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.566016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.566016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.566016] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.677014] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.728034] env[65359]: INFO networking_nsxv3.common.synchronization [req-72fb9f69-fd91-412d-b675-c39a998962dc req-d37fe99a-fc7e-4d89-8425-ec73507358e6 tempest-SecurityGroupRulesTestJSON-1992569406 tempest-SecurityGroupRulesTestJSON-1992569406-project-member] Enqueued Resource ID: fe7bef3e-827b-47d7-a58f-6ac6aed4f51f with Priority: HIGHEST for action security_group_rules [ 702.728634] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7bef3e-827b-47d7-a58f-6ac6aed4f51f with Priority: HIGHEST for action security_group_rules [ 702.728975] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe7bef3e-827b-47d7-a58f-6ac6aed4f51f taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.729532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe7bef3e-827b-47d7-a58f-6ac6aed4f51f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.729532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe7bef3e-827b-47d7-a58f-6ac6aed4f51f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.729928] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe7bef3e-827b-47d7-a58f-6ac6aed4f51f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.730088] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe7bef3e-827b-47d7-a58f-6ac6aed4f51f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.877876] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.998030] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.998275] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.998530] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.999501] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.999501] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.999501] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.999771] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.999936] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.000318] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.000404] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.000572] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.000776] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.000914] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.001091] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.001238] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.001591] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.021387] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.021387] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 703.021387] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.021791] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.022207] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-4d791d42-8260-4fe3-903b-56a1797f572a taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.022432] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-4d791d42-8260-4fe3-903b-56a1797f572a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.022576] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-4d791d42-8260-4fe3-903b-56a1797f572a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.022903] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-4d791d42-8260-4fe3-903b-56a1797f572a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.023090] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d791d42-8260-4fe3-903b-56a1797f572a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.066572] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.177422] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.177678] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.177730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.177957] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.178150] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.178222] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a4df49-7816-4678-be36-250c471235e3 is going to be updated. [ 703.208485] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.208741] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.208786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.209078] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.209266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.219236] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: IN_PROGRESS for 2s [ 703.255528] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.255890] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.255998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.256252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.256353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.256451] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe7bef3e-827b-47d7-a58f-6ac6aed4f51f already deleted. [ 703.256535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe7bef3e-827b-47d7-a58f-6ac6aed4f51f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.379821] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.380177] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.380177] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.380342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.380393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.380451] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 is going to be created. [ 703.406169] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.406169] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.406648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.406648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.406648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.416548] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 in Status: UNINITIALIZED for 2s [ 703.491162] env[65359]: INFO networking_nsxv3.common.synchronization [None req-a656c481-efb1-4068-8be1-284e47e86885 None None] Enqueued Resource ID: 6ad3cdd6-d8d1-4e4b-8ca0-a0c0365b1e0f with Priority: HIGHEST for action port [ 703.491853] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ad3cdd6-d8d1-4e4b-8ca0-a0c0365b1e0f with Priority: HIGHEST for action port [ 703.492281] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ad3cdd6-d8d1-4e4b-8ca0-a0c0365b1e0f taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.492426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ad3cdd6-d8d1-4e4b-8ca0-a0c0365b1e0f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.492495] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ad3cdd6-d8d1-4e4b-8ca0-a0c0365b1e0f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.492857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ad3cdd6-d8d1-4e4b-8ca0-a0c0365b1e0f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.492857] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ad3cdd6-d8d1-4e4b-8ca0-a0c0365b1e0f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.498349] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 703.498566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.526779] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.526779] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.526779] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.527205] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.527205] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.527275] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 4d791d42-8260-4fe3-903b-56a1797f572a not found, creating... [ 703.528028] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.528028] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.528028] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.528028] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.528331] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.528596] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.528596] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.528887] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.530592] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.531508] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.531691] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 4d791d42-8260-4fe3-903b-56a1797f572a is going to be created. [ 703.557075] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.557296] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.557429] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.557798] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.557901] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.558133] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-4d791d42-8260-4fe3-903b-56a1797f572a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.570043] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.995020] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ad3cdd6-d8d1-4e4b-8ca0-a0c0365b1e0f [ 703.995353] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.995496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.995570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.995802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.995885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.995995] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ad3cdd6-d8d1-4e4b-8ca0-a0c0365b1e0f already deleted. [ 703.996067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ad3cdd6-d8d1-4e4b-8ca0-a0c0365b1e0f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.072851] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.074308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.074395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.074685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.074785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.074925] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 582cfc14-9eeb-4704-a95a-052a5b40435e is going to be updated. [ 704.107011] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.107179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.107226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.107442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.107589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.119284] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: IN_PROGRESS for 2s [ 704.292364] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: SUCCESS [ 704.292836] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.292836] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.293133] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.293256] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.342527] env[65359]: INFO networking_nsxv3.common.synchronization [req-a522a999-bf75-4b80-bafe-58e5b05cf419 req-1885be2a-66ad-4f21-8c6f-6fcf3538b34d service nova] Enqueued Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_rules [ 704.342527] env[65359]: INFO networking_nsxv3.common.synchronization [req-a522a999-bf75-4b80-bafe-58e5b05cf419 req-1885be2a-66ad-4f21-8c6f-6fcf3538b34d service nova] Enqueued Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_members [ 704.342640] env[65359]: INFO networking_nsxv3.common.synchronization [req-a522a999-bf75-4b80-bafe-58e5b05cf419 req-1885be2a-66ad-4f21-8c6f-6fcf3538b34d service nova] Enqueued Resource ID: 4d791d42-8260-4fe3-903b-56a1797f572a with Priority: HIGHEST for action port [ 704.344969] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_rules [ 704.344969] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_members [ 704.344969] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d791d42-8260-4fe3-903b-56a1797f572a with Priority: HIGHEST for action port [ 704.344969] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-582cfc14-9eeb-4704-a95a-052a5b40435e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.344969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.344969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.344969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.344969] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.345306] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-582cfc14-9eeb-4704-a95a-052a5b40435e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.345473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.345775] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d791d42-8260-4fe3-903b-56a1797f572a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.345916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d791d42-8260-4fe3-903b-56a1797f572a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.345991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d791d42-8260-4fe3-903b-56a1797f572a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.346192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d791d42-8260-4fe3-903b-56a1797f572a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.346273] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d791d42-8260-4fe3-903b-56a1797f572a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.796136] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.796924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.822756] env[65359]: INFO networking_nsxv3.common.synchronization [req-9d2b84ae-38c8-4823-81ee-72008860348f req-aa17293b-d5f5-4ece-928e-399210bfdcec tempest-ImagesOneServerNegativeTestJSON-1491004073 tempest-ImagesOneServerNegativeTestJSON-1491004073-project-member] Enqueued Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 704.823410] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 704.823759] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.824036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.824036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.824470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.824783] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.824918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.825032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.825344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.825459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.825559] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.848270] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-582cfc14-9eeb-4704-a95a-052a5b40435e taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.848484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.849176] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d791d42-8260-4fe3-903b-56a1797f572a with status ACTIVE [ 704.849347] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.849347] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.849460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.849565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.849657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.849817] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.849923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.849980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.850149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.850223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.850556] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.850556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.850556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.850793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.850793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.850902] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d791d42-8260-4fe3-903b-56a1797f572a is going to be updated. [ 704.872281] env[65359]: INFO networking_nsxv3.common.synchronization [None req-dba0355f-95d6-4d09-bb3d-f9c15a52da3a tempest-ServersTestJSON-1097476844 tempest-ServersTestJSON-1097476844-project-member] Enqueued Resource ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 with Priority: HIGHEST for action security_group_rules [ 704.872710] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 with Priority: HIGHEST for action security_group_rules [ 704.873055] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.873426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.873426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.873558] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.873682] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.878080] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.878080] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.878213] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.878370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.878513] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.878973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d791d42-8260-4fe3-903b-56a1797f572a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.024671] env[65359]: INFO networking_nsxv3.common.synchronization [None req-38443139-500f-4271-81e0-b8c1d026b1d4 tempest-ServersTestJSON-1097476844 tempest-ServersTestJSON-1097476844-project-member] Enqueued Resource ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 with Priority: HIGHEST for action security_group_rules [ 705.026826] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 with Priority: HIGHEST for action security_group_rules [ 705.027381] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.027502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.245356] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: SUCCESS [ 705.247176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.247176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.247176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.247176] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.247176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.247176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.247176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.247176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.247176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.247176] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.329676] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.329993] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-196" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.329993] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-196" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.330315] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-196" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.330573] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.330818] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.330937] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.331165] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.331307] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.331537] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.331629] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.332410] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.332410] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.332410] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.332410] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.332410] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.334861] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.334971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.335050] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.335401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.335401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.335470] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.335596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.335596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.335730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.335803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.335883] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 already deleted. [ 705.335960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.353990] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.354174] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 705.354311] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.354473] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-196" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.354780] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-aadd439d-a3dc-437f-8c7d-3e288dd4eeff taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.354939] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-aadd439d-a3dc-437f-8c7d-3e288dd4eeff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.355064] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-aadd439d-a3dc-437f-8c7d-3e288dd4eeff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.355460] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-aadd439d-a3dc-437f-8c7d-3e288dd4eeff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.355493] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aadd439d-a3dc-437f-8c7d-3e288dd4eeff',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.394176] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.394448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.394556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.394896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.395037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.395170] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 already deleted. [ 705.396439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.396439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.396664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.396782] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.426689] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 in Status: SUCCESS [ 705.426932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.427115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.427590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.427590] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.427728] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.427763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.427898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.427979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.428073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.428161] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.752134] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.752134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.752134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.752134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.752134] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.752134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.752134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.752476] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.752476] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.752476] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.752568] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.752623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.752685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.752831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.752988] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.753102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.753171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.753432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.753432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.753432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.753552] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.812945] env[65359]: INFO networking_nsxv3.common.synchronization [None req-1e72b192-21ff-4c9f-8d1a-6347186ad9b7 None None] Enqueued Resource ID: 31a36861-cbd1-4624-8519-30ac7ed1eb29 with Priority: HIGHEST for action port [ 705.813699] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a36861-cbd1-4624-8519-30ac7ed1eb29 with Priority: HIGHEST for action port [ 705.818286] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-31a36861-cbd1-4624-8519-30ac7ed1eb29 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.819343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31a36861-cbd1-4624-8519-30ac7ed1eb29" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.819343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31a36861-cbd1-4624-8519-30ac7ed1eb29" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.819343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31a36861-cbd1-4624-8519-30ac7ed1eb29" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.819657] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a36861-cbd1-4624-8519-30ac7ed1eb29',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.858281] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.858479] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.858694] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.858934] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.859101] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.859250] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port aadd439d-a3dc-437f-8c7d-3e288dd4eeff not found, creating... [ 705.859689] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.859689] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.859817] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.860081] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.860218] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.860491] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.860704] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.861303] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.861593] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.861711] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.861879] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: aadd439d-a3dc-437f-8c7d-3e288dd4eeff is going to be created. [ 705.883404] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.883609] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.883728] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.884015] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.884241] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.884461] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-aadd439d-a3dc-437f-8c7d-3e288dd4eeff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.919332] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.919510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.919548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.919768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.919863] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.919960] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 already deleted. [ 705.920052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.935655] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.131274] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: SUCCESS [ 706.131468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.132131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.132131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.132293] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.132398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.132480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.132944] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.132944] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.132944] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.259294] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43a4df49-7816-4678-be36-250c471235e3: rpc.has_security_group_logging(os_id): False [ 706.283023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.283023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.283023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.283023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.283023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.283023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.283023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.283023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.283023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.283023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.283023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.283023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.283023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.283023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.283023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.283593] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.283593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.283593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.283593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.283593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.283747] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43a4df49-7816-4678-be36-250c471235e3 is going to be updated. [ 706.325882] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31a36861-cbd1-4624-8519-30ac7ed1eb29 [ 706.326236] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.326379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.326479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.326704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.326814] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.326990] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31a36861-cbd1-4624-8519-30ac7ed1eb29 already deleted. [ 706.327088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31a36861-cbd1-4624-8519-30ac7ed1eb29" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.382127] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.382127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.382127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.382605] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.382776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.404337] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: IN_PROGRESS for 2s [ 706.438285] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f94b344-4b21-4fd0-9c3a-2488e3e7e504: rpc.has_security_group_logging(os_id): False [ 706.465804] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.465804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.465804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.465804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.465804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.466139] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.466139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.466226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.466405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.466496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.466583] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 is going to be created. [ 706.608330] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.608330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.608330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.608507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.608619] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.637359] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 in Status: IN_PROGRESS for 2s [ 706.638715] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.744025] env[65359]: INFO networking_nsxv3.common.synchronization [req-9d2b84ae-38c8-4823-81ee-72008860348f req-86f5af51-d8c9-4c90-b464-4eeb5eca1ffd service nova] Enqueued Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_rules [ 706.744025] env[65359]: INFO networking_nsxv3.common.synchronization [req-9d2b84ae-38c8-4823-81ee-72008860348f req-86f5af51-d8c9-4c90-b464-4eeb5eca1ffd service nova] Enqueued Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 706.744025] env[65359]: INFO networking_nsxv3.common.synchronization [req-9d2b84ae-38c8-4823-81ee-72008860348f req-86f5af51-d8c9-4c90-b464-4eeb5eca1ffd service nova] Enqueued Resource ID: aadd439d-a3dc-437f-8c7d-3e288dd4eeff with Priority: HIGHEST for action port [ 706.744025] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_rules [ 706.744025] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 706.744025] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aadd439d-a3dc-437f-8c7d-3e288dd4eeff with Priority: HIGHEST for action port [ 706.744025] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.744025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.744025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.744025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.744025] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.744025] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.744025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.744025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.744025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.744025] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.744844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.744844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.744844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.744844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.744844] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.746178] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-aadd439d-a3dc-437f-8c7d-3e288dd4eeff taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.746314] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aadd439d-a3dc-437f-8c7d-3e288dd4eeff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.746361] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aadd439d-a3dc-437f-8c7d-3e288dd4eeff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.746554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aadd439d-a3dc-437f-8c7d-3e288dd4eeff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.746623] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aadd439d-a3dc-437f-8c7d-3e288dd4eeff',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.140784] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.180104] env[65359]: INFO networking_nsxv3.common.synchronization [None req-4f3bb62d-815d-4996-a15a-030c10198fd8 tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 with Priority: HIGHEST for action security_group_rules [ 707.180663] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 with Priority: HIGHEST for action security_group_rules [ 707.180972] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1f01646-6e50-4a59-a98b-3f8bba190b64 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.181160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.181160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.181418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.181483] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1f01646-6e50-4a59-a98b-3f8bba190b64',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.246411] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.248532] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.248710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.253074] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aadd439d-a3dc-437f-8c7d-3e288dd4eeff with status ACTIVE [ 707.253074] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.253074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.253074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.253074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.253074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.253074] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.253074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.253074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.253074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.253074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.253074] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.253074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.253074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.253074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.253074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.253074] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aadd439d-a3dc-437f-8c7d-3e288dd4eeff is going to be updated. [ 707.278331] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.278432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.278506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.278746] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.278900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.279156] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aadd439d-a3dc-437f-8c7d-3e288dd4eeff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.341760] env[65359]: INFO networking_nsxv3.common.synchronization [None req-38015b5b-ccfe-40c2-b1d1-0b98b77346c4 tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 with Priority: HIGHEST for action security_group_rules [ 707.344276] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 with Priority: HIGHEST for action security_group_rules [ 707.344638] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1f01646-6e50-4a59-a98b-3f8bba190b64 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.344746] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.517128] env[65359]: INFO networking_nsxv3.common.synchronization [req-209d152c-672f-49df-ae17-cad1a83a2508 req-e3f8b74c-aca1-4f73-b5ed-cec2f901da71 tempest-ServerDiskConfigTestJSON-2085995032 tempest-ServerDiskConfigTestJSON-2085995032-project-member] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 707.517899] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 707.518470] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.518470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.518627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.518785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.518979] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.519101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.519207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.519475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.520430] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.520430] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.643601] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.643779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.643885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.644141] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.644233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.644337] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 582cfc14-9eeb-4704-a95a-052a5b40435e is going to be updated. [ 707.688753] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.688753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.688753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.688753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.688753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.702142] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: IN_PROGRESS for 2s [ 707.708965] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.709197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.709197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.709861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.709861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.709861] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 already deleted. [ 707.709861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.709861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.710159] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.710159] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1f01646-6e50-4a59-a98b-3f8bba190b64',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.750296] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.993330] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-346 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.993507] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.993625] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.993973] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.994245] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.994397] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.994506] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.994716] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.994857] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.995513] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.995630] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.995737] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.995844] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.995949] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.996063] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.996196] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.022931] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.023343] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 708.023557] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.023815] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.024305] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-c761a4da-69c1-4d90-a41b-cdb5d7955c67 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.024568] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-c761a4da-69c1-4d90-a41b-cdb5d7955c67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.024753] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-c761a4da-69c1-4d90-a41b-cdb5d7955c67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.025210] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-c761a4da-69c1-4d90-a41b-cdb5d7955c67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.025422] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c761a4da-69c1-4d90-a41b-cdb5d7955c67',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.028143] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.029452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.029594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.029886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.030067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.030807] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.030807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.030807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.031012] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.031128] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.031267] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be updated. [ 708.062405] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.063153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.063297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.063513] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.063665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.073068] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: IN_PROGRESS for 2s [ 708.123036] env[65359]: INFO networking_nsxv3.common.synchronization [req-8875ca15-a315-4cab-9f23-f026ad1b28e0 req-7fe47c2f-23d1-4be6-9bdc-3166b39c044c tempest-FloatingIPsAssociationTestJSON-809440522 tempest-FloatingIPsAssociationTestJSON-809440522-project-member] Enqueued Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_members [ 708.123036] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGHEST for action security_group_members [ 708.123291] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.123501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.125038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.125038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.125038] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.125038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.125038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.125038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.125038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.125316] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.234245] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.234628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.234628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.234791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.234896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.235021] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 already deleted. [ 708.235131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.253822] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.253990] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.254044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.254260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.254348] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.254457] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 is going to be created. [ 708.280656] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.280870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.280946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.281172] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.281329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.293304] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: UNINITIALIZED for 2s [ 708.427539] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: SUCCESS [ 708.427801] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.427989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.428244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.428332] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.532027] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.532027] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.532027] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.532027] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.532027] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.532027] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port c761a4da-69c1-4d90-a41b-cdb5d7955c67 not found, creating... [ 708.532027] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.532027] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.532027] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.532027] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.532027] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.532442] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.532442] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.532890] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.533248] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.533633] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.533940] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: c761a4da-69c1-4d90-a41b-cdb5d7955c67 is going to be created. [ 708.561560] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.561560] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.561560] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.561560] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.562704] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.562704] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-c761a4da-69c1-4d90-a41b-cdb5d7955c67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.627434] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.627568] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.627614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.627843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.627940] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.628178] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.628284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.628349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.628523] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.628606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.628703] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6cbdd6f-4665-46af-8251-3803d47cff8b is going to be updated. [ 708.659191] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 in Status: SUCCESS [ 708.659191] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.685820] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.686127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.686127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.686424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.687451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.696688] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6cbdd6f-4665-46af-8251-3803d47cff8b in Status: IN_PROGRESS for 2s [ 708.930424] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.930587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.930660] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.930998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.931135] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.931241] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.931305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.931508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.931607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.931726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.931862] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.312637] env[65359]: INFO networking_nsxv3.common.synchronization [req-209d152c-672f-49df-ae17-cad1a83a2508 req-cf31460b-21aa-4df6-b330-3f2049e4dbda service nova] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_rules [ 709.312637] env[65359]: INFO networking_nsxv3.common.synchronization [req-209d152c-672f-49df-ae17-cad1a83a2508 req-cf31460b-21aa-4df6-b330-3f2049e4dbda service nova] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 709.313043] env[65359]: INFO networking_nsxv3.common.synchronization [req-209d152c-672f-49df-ae17-cad1a83a2508 req-cf31460b-21aa-4df6-b330-3f2049e4dbda service nova] Enqueued Resource ID: c761a4da-69c1-4d90-a41b-cdb5d7955c67 with Priority: HIGHEST for action port [ 709.313164] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_rules [ 709.313302] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 709.313397] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c761a4da-69c1-4d90-a41b-cdb5d7955c67 with Priority: HIGHEST for action port [ 709.313665] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.313791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.313858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.314070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.314165] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.315032] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.315169] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.315377] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-c761a4da-69c1-4d90-a41b-cdb5d7955c67 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.315550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c761a4da-69c1-4d90-a41b-cdb5d7955c67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.315550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c761a4da-69c1-4d90-a41b-cdb5d7955c67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.315704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c761a4da-69c1-4d90-a41b-cdb5d7955c67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.315778] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c761a4da-69c1-4d90-a41b-cdb5d7955c67',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.434160] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.434321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.434396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.434608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.434772] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.434878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.434939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.435107] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.435197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.435300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.435460] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.435555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.435624] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.435767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.435906] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.436092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.436092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.436215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.436289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.436384] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.436473] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.714888] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: IN_PROGRESS for 4s [ 709.817767] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.817932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.818732] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c761a4da-69c1-4d90-a41b-cdb5d7955c67 with status ACTIVE [ 709.818732] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.818732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.818732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.818732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.818970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.819175] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.819351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.819450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.819659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.819921] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.820029] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.820140] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.820222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.820394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.820492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.821037] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c761a4da-69c1-4d90-a41b-cdb5d7955c67 is going to be updated. [ 709.858085] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.858293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.858375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.858621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.858767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.858936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c761a4da-69c1-4d90-a41b-cdb5d7955c67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.938815] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43a4df49-7816-4678-be36-250c471235e3: rpc.has_security_group_logging(os_id): False [ 709.959127] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.959277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.959348] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.959568] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.959656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.959929] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.960043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.960106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.960261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.960548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.960785] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.960891] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.960953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.961153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.961240] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.961445] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.961534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.961596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.961796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.961796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.961898] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43a4df49-7816-4678-be36-250c471235e3 is going to be updated. [ 710.051916] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.052051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.052205] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.052475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.052655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.069013] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: IN_PROGRESS for 2s [ 710.092079] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 710.092322] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b deletion is rescheduled due to dependency. [ 710.092444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.092607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.092867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.093096] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.093286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.093354] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.093552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.093675] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.093718] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.305799] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: SUCCESS [ 710.306068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.306270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.310016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.310016] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.310016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.310016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.310016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.310016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.310016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.310016] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.597748] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.709314] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6cbdd6f-4665-46af-8251-3803d47cff8b in Status: SUCCESS [ 710.709939] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6cbdd6f-4665-46af-8251-3803d47cff8b deletion is rescheduled due to dependency. [ 710.710153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.814110] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.814697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.814844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.815099] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.815444] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.815444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.815582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.815612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.815812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.815812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.815935] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.816028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.816095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.816237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.816368] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.816458] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.816518] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.816650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.816726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.816807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.817062] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.101620] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.322594] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f713e30a-d102-48fb-9e09-3c3ec7abbc99: rpc.has_security_group_logging(os_id): False [ 711.343498] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.345215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.345215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.345215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.345215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.345424] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.345604] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.345714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.345976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.346113] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.346417] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.346574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.346653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.346827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.346901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.347106] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.347198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.347256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.347441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.347572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.347645] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 is going to be created. [ 711.420587] env[65359]: INFO networking_nsxv3.common.synchronization [req-724d7be5-8aa0-4512-afc6-56999a117027 req-059597ab-ddb8-43b2-a2e2-de8ad6df60b0 tempest-SecurityGroupRulesTestJSON-1992569406 tempest-SecurityGroupRulesTestJSON-1992569406-project-member] Enqueued Resource ID: bae403e8-26c8-4ec3-8977-639c42a38268 with Priority: HIGHEST for action security_group_rules [ 711.422207] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bae403e8-26c8-4ec3-8977-639c42a38268 with Priority: HIGHEST for action security_group_rules [ 711.422207] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bae403e8-26c8-4ec3-8977-639c42a38268 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.422207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bae403e8-26c8-4ec3-8977-639c42a38268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.422207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bae403e8-26c8-4ec3-8977-639c42a38268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.423049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bae403e8-26c8-4ec3-8977-639c42a38268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.423137] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bae403e8-26c8-4ec3-8977-639c42a38268',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.466177] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.466388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.466448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.467742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.468013] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.494247] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: IN_PROGRESS for 2s [ 711.605044] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.605412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.605412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.605710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.605837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.605945] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be updated. [ 711.651866] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.652322] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.652465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.653126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.653396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.666484] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: IN_PROGRESS for 2s [ 711.730017] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: SUCCESS [ 711.730815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.730815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.730815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.731162] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.731162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.731162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.731307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.731402] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.731463] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.731573] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.917317] env[65359]: INFO networking_nsxv3.common.synchronization [req-d013ba55-cdbf-4a90-a667-fd0a6e85a9c7 req-f4f75261-07a8-45d5-8758-1d8f62373f11 tempest-DeleteServersTestJSON-2065668722 tempest-DeleteServersTestJSON-2065668722-project-member] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 711.917999] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 711.918328] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.918459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.918564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.919017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.919191] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.919297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.919372] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.919516] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.919592] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.919693] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.949959] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.950270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.950270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.950680] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.950680] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.950680] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bae403e8-26c8-4ec3-8977-639c42a38268 already deleted. [ 711.950914] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bae403e8-26c8-4ec3-8977-639c42a38268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.090495] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: SUCCESS [ 712.092150] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.234695] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-582cfc14-9eeb-4704-a95a-052a5b40435e taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.234695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.234695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.234695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.235405] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.235405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.235543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.235780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.236500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.236500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.236500] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-582cfc14-9eeb-4704-a95a-052a5b40435e taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.236500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.236695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.236890] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.237167] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.237333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.237453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.237672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.237806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.238034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.238260] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.422443] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.422630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.422707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.422944] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.423052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.423284] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.423349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.423412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.423562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.423636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.423721] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 712.451814] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.452039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.452125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.452711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.452861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.463331] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 712.741465] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 582cfc14-9eeb-4704-a95a-052a5b40435e: rpc.has_security_group_logging(os_id): False [ 712.766849] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.767132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.767132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.767403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.767541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.767905] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.768121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.768121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.768222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.768283] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.768511] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.768617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.768677] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.768854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.768935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.769180] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.769275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.769341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.769575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.769662] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.769862] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 582cfc14-9eeb-4704-a95a-052a5b40435e is going to be updated. [ 712.894281] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.894281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.894281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.894281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.894544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.915395] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: IN_PROGRESS for 2s [ 713.512386] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: SUCCESS [ 713.512386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.679668] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 713.679668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.679668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.679668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.679668] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.679668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.679668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.679668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.679668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.679668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.679668] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.183317] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.183616] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.183616] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.183854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.183961] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.184234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.184234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.184445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.184586] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.184705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.184920] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.185058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.185170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.185363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.185638] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.185704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.185774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.185975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.187527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.187644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.187757] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.474914] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 714.475035] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb deletion is rescheduled due to dependency. [ 714.475139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.484019] env[65359]: INFO networking_nsxv3.common.synchronization [req-3231683d-762f-4054-b556-93c775f52f8a req-58dffa83-43f6-4164-8d69-11990f1505ed tempest-ImagesTestJSON-1497561183 tempest-ImagesTestJSON-1497561183-project-member] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 714.484019] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 714.484019] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.484019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.484019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.484019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.484019] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.484019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.484019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.484019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.484019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.484019] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.690701] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4dca704-f8c2-494f-bbf6-802020c49b4b: rpc.has_security_group_logging(os_id): False [ 714.714197] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.714197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.714331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.714612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.714612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.714805] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.714933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.714982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.715163] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.715227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.715418] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.715537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.715590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.715741] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.715815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.716026] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.716239] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.716298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.716483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.716541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.716581] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be updated. [ 714.796709] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.796927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.797059] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.797433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.797666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.817841] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: IN_PROGRESS for 2s [ 714.934822] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: SUCCESS [ 714.935110] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.943575] env[65359]: INFO networking_nsxv3.common.synchronization [req-fe51a0d0-fe32-4332-9003-b3649451df47 req-774552c8-8694-436c-ab8f-b253ccaaef41 tempest-ListServersNegativeTestJSON-2074596717 tempest-ListServersNegativeTestJSON-2074596717-project-member] Enqueued Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 714.944497] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 714.944831] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.944961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.945044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.945248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.945404] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.945507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.945570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.945712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.945802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.945902] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.986124] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.986272] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.986344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.986558] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.986673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.986848] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.986976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.987152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.987229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.987398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.987398] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 715.021613] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.021613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.021816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.022091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.022335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.035435] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 715.449968] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.953302] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.456241] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.456614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.456614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.457369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.457369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.457369] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a4df49-7816-4678-be36-250c471235e3 is going to be updated. [ 716.494238] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.494406] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.494448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.494808] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.495111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.506800] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: IN_PROGRESS for 2s [ 716.813129] env[65359]: INFO networking_nsxv3.common.synchronization [None req-2046a703-fa26-47bf-8203-eb01595628e3 None None] Enqueued Resource ID: 1c7dffde-591a-4c4e-9feb-31f16e5eaa83 with Priority: HIGHEST for action port [ 716.813908] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c7dffde-591a-4c4e-9feb-31f16e5eaa83 with Priority: HIGHEST for action port [ 716.815375] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c7dffde-591a-4c4e-9feb-31f16e5eaa83 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.816178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c7dffde-591a-4c4e-9feb-31f16e5eaa83" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.816422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c7dffde-591a-4c4e-9feb-31f16e5eaa83" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.817177] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c7dffde-591a-4c4e-9feb-31f16e5eaa83" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.817424] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c7dffde-591a-4c4e-9feb-31f16e5eaa83',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.833181] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 716.833181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.904972] env[65359]: INFO networking_nsxv3.common.synchronization [req-a82f0d01-b8f3-4905-bc7a-b130d0f605d0 req-2ab9ffd7-f68b-41da-9c9c-88d4c8e0d55e tempest-SecurityGroupRulesTestJSON-1992569406 tempest-SecurityGroupRulesTestJSON-1992569406-project-member] Enqueued Resource ID: 5d5927b4-09ff-41ab-bae6-75f2e4436743 with Priority: HIGHEST for action security_group_rules [ 716.905460] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d5927b4-09ff-41ab-bae6-75f2e4436743 with Priority: HIGHEST for action security_group_rules [ 716.906124] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d5927b4-09ff-41ab-bae6-75f2e4436743 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.906124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d5927b4-09ff-41ab-bae6-75f2e4436743" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.906270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d5927b4-09ff-41ab-bae6-75f2e4436743" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.906587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d5927b4-09ff-41ab-bae6-75f2e4436743" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.906703] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d5927b4-09ff-41ab-bae6-75f2e4436743',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.047171] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 717.047375] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 deletion is rescheduled due to dependency. [ 717.047545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.323444] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c7dffde-591a-4c4e-9feb-31f16e5eaa83 [ 717.323444] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.323444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.323444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.323444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.323444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.323444] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c7dffde-591a-4c4e-9feb-31f16e5eaa83 already deleted. [ 717.323444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c7dffde-591a-4c4e-9feb-31f16e5eaa83" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.416711] env[65359]: INFO networking_nsxv3.common.synchronization [req-12f2bd3a-1ac9-46fc-a266-16cb482c943b req-2401c592-1580-41b5-bc4a-aa9d32de9d50 tempest-ServersTestJSON-1929866617 tempest-ServersTestJSON-1929866617-project-member] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 717.416711] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 717.416711] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.416711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.416711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.416953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.417139] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.417235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.417315] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.417473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.420942] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.420942] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.429885] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.430124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.430239] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.431028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.431028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.431028] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d5927b4-09ff-41ab-bae6-75f2e4436743 already deleted. [ 717.431028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d5927b4-09ff-41ab-bae6-75f2e4436743" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.851296] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.851617] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.851672] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.852140] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.852473] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.852657] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.852822] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.853064] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.853212] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.853415] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.853525] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.853631] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.853783] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.853979] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.854129] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.854302] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.875239] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.875460] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 717.875764] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.876021] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.876337] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.876503] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.876630] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.876943] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.877094] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.919847] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.920080] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.920153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.920383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.920512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.920734] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.920904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.920957] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.921135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.921217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.921308] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 already deleted. [ 717.921401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.379615] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.379920] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.380056] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.380323] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.380462] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.380608] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8 not found, creating... [ 718.380956] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.381034] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.381146] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.381355] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.381479] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.381760] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.381904] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.382111] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.382334] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.382463] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.382592] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8 is going to be created. [ 718.402937] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.403222] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.403354] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.403613] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.403825] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.404051] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.517304] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: SUCCESS [ 718.517644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.539837] env[65359]: INFO networking_nsxv3.common.synchronization [None req-4a79388a-b31d-49d7-b9f1-4134aae66c9c None None] Enqueued Resource ID: 2246f907-e4ce-4083-ab6d-d7a536b86f0c with Priority: HIGHEST for action port [ 718.540023] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2246f907-e4ce-4083-ab6d-d7a536b86f0c with Priority: HIGHEST for action port [ 718.540226] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-2246f907-e4ce-4083-ab6d-d7a536b86f0c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.540367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2246f907-e4ce-4083-ab6d-d7a536b86f0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.540412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2246f907-e4ce-4083-ab6d-d7a536b86f0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.540664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2246f907-e4ce-4083-ab6d-d7a536b86f0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.540747] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2246f907-e4ce-4083-ab6d-d7a536b86f0c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.043680] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2246f907-e4ce-4083-ab6d-d7a536b86f0c [ 719.043982] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.044073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.044442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.044442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.044442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.044565] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2246f907-e4ce-4083-ab6d-d7a536b86f0c already deleted. [ 719.044595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2246f907-e4ce-4083-ab6d-d7a536b86f0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.198054] env[65359]: INFO networking_nsxv3.common.synchronization [req-12f2bd3a-1ac9-46fc-a266-16cb482c943b req-54b12184-7c98-455e-9db6-bdc5686de319 service nova] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_rules [ 719.198243] env[65359]: INFO networking_nsxv3.common.synchronization [req-12f2bd3a-1ac9-46fc-a266-16cb482c943b req-54b12184-7c98-455e-9db6-bdc5686de319 service nova] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 719.198397] env[65359]: INFO networking_nsxv3.common.synchronization [req-12f2bd3a-1ac9-46fc-a266-16cb482c943b req-54b12184-7c98-455e-9db6-bdc5686de319 service nova] Enqueued Resource ID: 15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8 with Priority: HIGHEST for action port [ 719.199023] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_rules [ 719.199144] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 719.199236] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8 with Priority: HIGHEST for action port [ 719.199517] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.199648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.199713] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.200014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.203648] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.203648] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.203730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.203759] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.204016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.204429] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.204429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.204429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.204429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.204577] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.204577] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.205430] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.205532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.205596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.205751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.205824] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.481335] env[65359]: INFO networking_nsxv3.common.synchronization [req-d5f298c6-5c7a-42a1-afea-3bc4f940f064 req-df834151-46d2-4ba0-a58a-99654f7493b6 tempest-SecurityGroupRulesTestJSON-1992569406 tempest-SecurityGroupRulesTestJSON-1992569406-project-member] Enqueued Resource ID: 5d5927b4-09ff-41ab-bae6-75f2e4436743 with Priority: HIGHEST for action security_group_rules [ 719.482041] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d5927b4-09ff-41ab-bae6-75f2e4436743 with Priority: HIGHEST for action security_group_rules [ 719.483359] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d5927b4-09ff-41ab-bae6-75f2e4436743 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.483518] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d5927b4-09ff-41ab-bae6-75f2e4436743" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.483709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d5927b4-09ff-41ab-bae6-75f2e4436743" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.484091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d5927b4-09ff-41ab-bae6-75f2e4436743" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.484188] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d5927b4-09ff-41ab-bae6-75f2e4436743',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.643081] env[65359]: INFO networking_nsxv3.common.synchronization [None req-741bec30-cdf9-4c40-b6ef-c6a5d1b89b84 tempest-AttachVolumeTestJSON-1956829346 tempest-AttachVolumeTestJSON-1956829346-project-member] Enqueued Resource ID: 52365fff-e017-4d11-ba53-f5893d863536 with Priority: HIGHEST for action security_group_rules [ 719.644971] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52365fff-e017-4d11-ba53-f5893d863536 with Priority: HIGHEST for action security_group_rules [ 719.645458] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52365fff-e017-4d11-ba53-f5893d863536 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.645636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.645713] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.645975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.646986] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52365fff-e017-4d11-ba53-f5893d863536',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.658795] env[65359]: INFO networking_nsxv3.common.synchronization [None req-9dbcc02f-9bbe-4cf6-aaf7-e2fe655a2150 None None] Enqueued Resource ID: 7e3f4c5d-f7fa-417c-a358-bbdeaaa5fb95 with Priority: HIGHEST for action port [ 719.658795] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e3f4c5d-f7fa-417c-a358-bbdeaaa5fb95 with Priority: HIGHEST for action port [ 719.658795] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e3f4c5d-f7fa-417c-a358-bbdeaaa5fb95 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.658795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e3f4c5d-f7fa-417c-a358-bbdeaaa5fb95" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.658795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e3f4c5d-f7fa-417c-a358-bbdeaaa5fb95" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.658795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e3f4c5d-f7fa-417c-a358-bbdeaaa5fb95" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.658795] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e3f4c5d-f7fa-417c-a358-bbdeaaa5fb95',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.708805] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.713650] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.713771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.714309] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8 with status ACTIVE [ 719.714309] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.714309] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.714309] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.714493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.714561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.715074] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.715074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.715074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.715562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.715562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.715653] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.715703] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.715732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.715888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.715956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.716049] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8 is going to be updated. [ 719.743395] env[65359]: INFO networking_nsxv3.common.synchronization [None req-050b98e2-fb47-43d0-892c-889bf592943f tempest-AttachVolumeTestJSON-1956829346 tempest-AttachVolumeTestJSON-1956829346-project-member] Enqueued Resource ID: 52365fff-e017-4d11-ba53-f5893d863536 with Priority: HIGHEST for action security_group_rules [ 719.744430] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.744860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.744860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.745055] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.745191] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.745566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15b90ed3-c6cb-4465-acfe-2d2bb1f78fe8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.745792] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52365fff-e017-4d11-ba53-f5893d863536 with Priority: HIGHEST for action security_group_rules [ 719.746095] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52365fff-e017-4d11-ba53-f5893d863536 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.746227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.006899] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.007063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.007183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.007349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.007433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.007532] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d5927b4-09ff-41ab-bae6-75f2e4436743 already deleted. [ 720.007612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d5927b4-09ff-41ab-bae6-75f2e4436743" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.161416] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e3f4c5d-f7fa-417c-a358-bbdeaaa5fb95 [ 720.162092] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.162092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.162092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.162265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.162299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.162409] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e3f4c5d-f7fa-417c-a358-bbdeaaa5fb95 already deleted. [ 720.162625] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e3f4c5d-f7fa-417c-a358-bbdeaaa5fb95" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.171329] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.171329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.171504] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.172029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.172029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.176556] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52365fff-e017-4d11-ba53-f5893d863536 already deleted. [ 720.176556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.176556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.176556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.176800] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52365fff-e017-4d11-ba53-f5893d863536',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.214028] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.703833] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.705333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.705534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.705728] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.705828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.705947] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52365fff-e017-4d11-ba53-f5893d863536 already deleted. [ 720.706116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.721928] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.721928] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.722107] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.722653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.722653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.722653] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be created. [ 720.764978] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.765171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.765333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.765557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.765718] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.779736] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: UNINITIALIZED for 2s [ 720.978479] env[65359]: INFO networking_nsxv3.common.synchronization [None req-d3e238cb-9eca-4baf-a2e9-ba2b879f4d11 None None] Enqueued Resource ID: 2ccd8492-b526-4641-a654-98a492989d64 with Priority: HIGHEST for action port [ 720.979362] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ccd8492-b526-4641-a654-98a492989d64 with Priority: HIGHEST for action port [ 720.979553] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ccd8492-b526-4641-a654-98a492989d64 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.979658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ccd8492-b526-4641-a654-98a492989d64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.979722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ccd8492-b526-4641-a654-98a492989d64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.979963] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ccd8492-b526-4641-a654-98a492989d64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.980156] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ccd8492-b526-4641-a654-98a492989d64',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.482908] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ccd8492-b526-4641-a654-98a492989d64 [ 721.483375] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.483375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.483375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.483703] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.483703] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.483854] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ccd8492-b526-4641-a654-98a492989d64 already deleted. [ 721.483854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ccd8492-b526-4641-a654-98a492989d64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.732221] env[65359]: INFO networking_nsxv3.common.synchronization [req-611476b1-751f-4fed-a5a2-a792c290ace1 req-27f50703-bd56-41c2-b9e1-dfb8cd387823 tempest-SecurityGroupRulesTestJSON-1992569406 tempest-SecurityGroupRulesTestJSON-1992569406-project-member] Enqueued Resource ID: 5d5927b4-09ff-41ab-bae6-75f2e4436743 with Priority: HIGHEST for action security_group_rules [ 721.732947] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d5927b4-09ff-41ab-bae6-75f2e4436743 with Priority: HIGHEST for action security_group_rules [ 721.733348] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d5927b4-09ff-41ab-bae6-75f2e4436743 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.733473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d5927b4-09ff-41ab-bae6-75f2e4436743" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.733537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d5927b4-09ff-41ab-bae6-75f2e4436743" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.733750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d5927b4-09ff-41ab-bae6-75f2e4436743" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.733856] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d5927b4-09ff-41ab-bae6-75f2e4436743',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.260614] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.260614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.260792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.260934] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.261047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.261147] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d5927b4-09ff-41ab-bae6-75f2e4436743 already deleted. [ 722.262274] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d5927b4-09ff-41ab-bae6-75f2e4436743" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.526555] env[65359]: INFO networking_nsxv3.common.synchronization [req-faf71ef9-8e04-4b96-89c0-268fb6c47503 req-7745e7e0-126a-4601-b912-3ae902a4803a tempest-FloatingIPsAssociationNegativeTestJSON-1657137340 tempest-FloatingIPsAssociationNegativeTestJSON-1657137340-project-member] Enqueued Resource ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd with Priority: HIGHEST for action security_group_members [ 722.526555] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd with Priority: HIGHEST for action security_group_members [ 722.527064] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.527727] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.527727] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.527892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.528147] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.528317] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.528317] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.528837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.528837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.528837] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46b0db53-8bd6-4cc8-90b3-dd8299fa29cd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.789710] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 722.790054] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.790264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.790524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.790763] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.790947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.791060] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.791332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.791332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.791480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.791599] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.032315] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.032466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.032536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.032824] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.032929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.033053] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.034109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.034109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.034109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.034109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.034109] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd is going to be updated. [ 723.067387] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.067643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.067714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.067907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.068062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.079741] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd in Status: IN_PROGRESS for 2s [ 723.294588] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.294847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.294847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.295028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.296136] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.296136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.296136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.296136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.296136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.296136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.296933] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.298980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.299089] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.299284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.299859] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.300360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.300360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.300360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.300521] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.300593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.300682] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.544460] env[65359]: INFO networking_nsxv3.common.synchronization [req-2de72aad-a0f5-49b0-b644-974f42ff805d req-cf2ae78f-3b48-46bb-a4af-eead3b1c11b1 tempest-ServerGroupTestJSON-1328219482 tempest-ServerGroupTestJSON-1328219482-project-member] Enqueued Resource ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 with Priority: HIGHEST for action security_group_members [ 723.549257] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 with Priority: HIGHEST for action security_group_members [ 723.549257] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cada3c1-366e-43a5-923b-57e235de0cb4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.549257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.549257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.549257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.549257] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.549257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.549257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.549257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.549257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.549257] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cada3c1-366e-43a5-923b-57e235de0cb4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.642414] env[65359]: INFO networking_nsxv3.common.synchronization [req-d52b2db0-b74e-4aa1-bb2d-e70c32cafb3b req-84ffe564-2a66-4839-9f76-82f7c395a371 tempest-AttachInterfacesUnderV243Test-943312976 tempest-AttachInterfacesUnderV243Test-943312976-project-member] Enqueued Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_members [ 723.642977] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_members [ 723.647352] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.647352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.647352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.647352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.647352] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.647352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.647352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.647352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.647352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.647352] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.671022] env[65359]: INFO networking_nsxv3.common.synchronization [req-d52b2db0-b74e-4aa1-bb2d-e70c32cafb3b req-84ffe564-2a66-4839-9f76-82f7c395a371 tempest-AttachInterfacesUnderV243Test-943312976 tempest-AttachInterfacesUnderV243Test-943312976-project-member] Enqueued Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_rules [ 723.671022] env[65359]: INFO networking_nsxv3.common.synchronization [req-d52b2db0-b74e-4aa1-bb2d-e70c32cafb3b req-84ffe564-2a66-4839-9f76-82f7c395a371 tempest-AttachInterfacesUnderV243Test-943312976 tempest-AttachInterfacesUnderV243Test-943312976-project-member] Enqueued Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_members [ 723.671022] env[65359]: INFO networking_nsxv3.common.synchronization [req-d52b2db0-b74e-4aa1-bb2d-e70c32cafb3b req-84ffe564-2a66-4839-9f76-82f7c395a371 tempest-AttachInterfacesUnderV243Test-943312976 tempest-AttachInterfacesUnderV243Test-943312976-project-member] Enqueued Resource ID: 7a774f65-eb86-4cb0-9805-e0988c11cded with Priority: HIGHEST for action port [ 723.671022] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_rules [ 723.671022] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_members [ 723.671022] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a774f65-eb86-4cb0-9805-e0988c11cded with Priority: HIGHEST for action port [ 723.671022] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.671805] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.671979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.672268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.672430] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.673804] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.675742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.675742] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a774f65-eb86-4cb0-9805-e0988c11cded taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.675742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.675742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.675742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.675742] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a774f65-eb86-4cb0-9805-e0988c11cded',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.806460] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5: rpc.has_security_group_logging(os_id): False [ 723.827316] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.827656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.828144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.828144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.828590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.828947] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.829732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.829732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.829732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.829732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.829732] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.829732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.830020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.830149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.830273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.830556] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.830782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.830892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.831235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.831288] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.831401] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be created. [ 723.895083] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.895083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.895083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.895083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.895083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.910345] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 724.000513] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-989 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.000775] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-989" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.000946] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-989" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.001285] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-989" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.001546] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.001715] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.001811] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.002031] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.002170] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.002527] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.002527] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.002614] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.002660] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.002757] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.002851] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.002981] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.023166] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.023370] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 724.023504] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.024099] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-989" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.024099] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-e68aae53-f946-4c68-94af-516c7f54773e taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.024540] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-e68aae53-f946-4c68-94af-516c7f54773e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.024540] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-e68aae53-f946-4c68-94af-516c7f54773e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.025143] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-e68aae53-f946-4c68-94af-516c7f54773e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.025143] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e68aae53-f946-4c68-94af-516c7f54773e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.054345] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.054345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.054345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.055128] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.055128] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.055128] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.055128] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.055128] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.055362] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.055362] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.055362] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 already deleted. [ 724.055532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.150926] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.178221] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.178357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.178593] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a774f65-eb86-4cb0-9805-e0988c11cded with status ACTIVE [ 724.178915] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.179035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.179035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.179281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.179378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.179603] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.179817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.179890] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.180090] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.180172] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.180716] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.180716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.180716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.181976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.182056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.182172] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a774f65-eb86-4cb0-9805-e0988c11cded is going to be updated. [ 724.211120] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.211120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.211120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.211120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.211120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.211716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.532025] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.532025] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.532025] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.532025] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.532025] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.532025] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port e68aae53-f946-4c68-94af-516c7f54773e not found, creating... [ 724.532025] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.532025] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.532025] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.532025] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.532025] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.532493] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.532493] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.532493] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.532493] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.532493] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.532493] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: e68aae53-f946-4c68-94af-516c7f54773e is going to be created. [ 724.552984] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.552984] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.553457] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.553457] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.554105] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.554105] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-e68aae53-f946-4c68-94af-516c7f54773e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.653842] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.094529] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd in Status: SUCCESS [ 725.095675] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd deletion is rescheduled due to dependency. [ 725.096183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.157218] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.157218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.157218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.157218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.157218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.157218] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 703826e2-1d66-436e-9721-f997727e26c4 is going to be updated. [ 725.194795] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.194795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.195053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.195626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.195626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.207132] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: IN_PROGRESS for 2s [ 725.332362] env[65359]: INFO networking_nsxv3.common.synchronization [req-2de72aad-a0f5-49b0-b644-974f42ff805d req-aa817a48-6900-4f80-98dc-00ca9b11d53a service nova] Enqueued Resource ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 with Priority: HIGHEST for action security_group_rules [ 725.332362] env[65359]: INFO networking_nsxv3.common.synchronization [req-2de72aad-a0f5-49b0-b644-974f42ff805d req-aa817a48-6900-4f80-98dc-00ca9b11d53a service nova] Enqueued Resource ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 with Priority: HIGHEST for action security_group_members [ 725.332362] env[65359]: INFO networking_nsxv3.common.synchronization [req-2de72aad-a0f5-49b0-b644-974f42ff805d req-aa817a48-6900-4f80-98dc-00ca9b11d53a service nova] Enqueued Resource ID: e68aae53-f946-4c68-94af-516c7f54773e with Priority: HIGHEST for action port [ 725.333097] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 with Priority: HIGHEST for action security_group_rules [ 725.333097] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 with Priority: HIGHEST for action security_group_members [ 725.333729] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e68aae53-f946-4c68-94af-516c7f54773e with Priority: HIGHEST for action port [ 725.333729] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cada3c1-366e-43a5-923b-57e235de0cb4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.333729] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.333729] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.334269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.334269] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cada3c1-366e-43a5-923b-57e235de0cb4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.338139] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cada3c1-366e-43a5-923b-57e235de0cb4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.338139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.338139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.338139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.338139] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.338139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.338139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.338139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.338139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.338139] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cada3c1-366e-43a5-923b-57e235de0cb4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.339649] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-e68aae53-f946-4c68-94af-516c7f54773e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.339849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e68aae53-f946-4c68-94af-516c7f54773e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.339937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e68aae53-f946-4c68-94af-516c7f54773e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.340119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e68aae53-f946-4c68-94af-516c7f54773e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.340195] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e68aae53-f946-4c68-94af-516c7f54773e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.836864] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cada3c1-366e-43a5-923b-57e235de0cb4 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.837339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.841909] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cada3c1-366e-43a5-923b-57e235de0cb4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.845191] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e68aae53-f946-4c68-94af-516c7f54773e with status ACTIVE [ 725.845415] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.845558] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.845628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.845863] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.845961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.846170] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.846271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.846329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.846528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.846561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.846727] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.846821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.846875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.847020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.847095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.847182] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e68aae53-f946-4c68-94af-516c7f54773e is going to be updated. [ 725.909138] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.909138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.909138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.909138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.909138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.909138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e68aae53-f946-4c68-94af-516c7f54773e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.923677] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 725.924496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.345641] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cada3c1-366e-43a5-923b-57e235de0cb4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.593976] env[65359]: INFO networking_nsxv3.common.synchronization [req-0c5ae03e-a910-41a6-a15b-005c3ebc18f8 req-6b759525-cea0-4aee-a061-2894824d7551 tempest-TenantUsagesTestJSON-1872062642 tempest-TenantUsagesTestJSON-1872062642-project-member] Enqueued Resource ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 with Priority: HIGHEST for action security_group_members [ 726.594709] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 with Priority: HIGHEST for action security_group_members [ 726.595691] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.595691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.595691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.595877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.596076] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.596219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.596320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.596564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.596693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.596891] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e01edf8-56d4-4ad5-91cc-fcc882a409c8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.848106] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.848400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.848400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.848854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.848986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.849182] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 is going to be created. [ 726.874760] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.874845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.874912] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.875964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.875964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.887801] env[65359]: INFO networking_nsxv3.common.synchronization [None req-de29c21a-f37e-41ed-921c-3fb8bf745ee1 None None] Enqueued Resource ID: dca822b5-6a4c-4317-bb9c-98599bd07d2b with Priority: HIGHEST for action port [ 726.889010] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 in Status: UNINITIALIZED for 2s [ 726.889980] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dca822b5-6a4c-4317-bb9c-98599bd07d2b with Priority: HIGHEST for action port [ 726.889980] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-dca822b5-6a4c-4317-bb9c-98599bd07d2b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.889980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dca822b5-6a4c-4317-bb9c-98599bd07d2b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.889980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dca822b5-6a4c-4317-bb9c-98599bd07d2b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.890245] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dca822b5-6a4c-4317-bb9c-98599bd07d2b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.890340] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dca822b5-6a4c-4317-bb9c-98599bd07d2b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.035621] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.035808] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.035917] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.036197] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.036447] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.036604] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.036824] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.037220] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.037394] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.037600] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.037705] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.037806] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.037905] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.038213] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.038404] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.038611] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.058118] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.058477] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 727.058477] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.058660] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.059150] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-5d06ad84-2e9d-4da2-b258-8ec3317a062a taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.060223] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-5d06ad84-2e9d-4da2-b258-8ec3317a062a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.060223] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-5d06ad84-2e9d-4da2-b258-8ec3317a062a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.060223] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-5d06ad84-2e9d-4da2-b258-8ec3317a062a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.060223] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d06ad84-2e9d-4da2-b258-8ec3317a062a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.099718] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.099893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.099982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.100757] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.100757] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.100757] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.100757] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.100757] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.101014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.101067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.101241] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 already deleted. [ 727.101311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.217746] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: SUCCESS [ 727.217957] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.218133] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.218385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.218523] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.218636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.218702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.218852] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.218935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.219064] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.393297] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dca822b5-6a4c-4317-bb9c-98599bd07d2b [ 727.393552] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.393552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.393734] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.393883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.393924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.394034] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dca822b5-6a4c-4317-bb9c-98599bd07d2b already deleted. [ 727.394216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dca822b5-6a4c-4317-bb9c-98599bd07d2b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.563040] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.563257] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.563376] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.565242] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.565435] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.565591] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 5d06ad84-2e9d-4da2-b258-8ec3317a062a not found, creating... [ 727.565857] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.566016] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.566133] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.566352] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.566481] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.566758] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.566907] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.567094] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.567315] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.567443] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.567574] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 5d06ad84-2e9d-4da2-b258-8ec3317a062a is going to be created. [ 727.589015] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.589140] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.589189] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.589586] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.589751] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.589953] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-5d06ad84-2e9d-4da2-b258-8ec3317a062a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.721987] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.224192] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.352797] env[65359]: INFO networking_nsxv3.common.synchronization [req-0c5ae03e-a910-41a6-a15b-005c3ebc18f8 req-05ffb74a-c52c-49ea-9314-99bf2779875c service nova] Enqueued Resource ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 with Priority: HIGHEST for action security_group_rules [ 728.353064] env[65359]: INFO networking_nsxv3.common.synchronization [req-0c5ae03e-a910-41a6-a15b-005c3ebc18f8 req-05ffb74a-c52c-49ea-9314-99bf2779875c service nova] Enqueued Resource ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 with Priority: HIGHEST for action security_group_members [ 728.353227] env[65359]: INFO networking_nsxv3.common.synchronization [req-0c5ae03e-a910-41a6-a15b-005c3ebc18f8 req-05ffb74a-c52c-49ea-9314-99bf2779875c service nova] Enqueued Resource ID: 5d06ad84-2e9d-4da2-b258-8ec3317a062a with Priority: HIGHEST for action port [ 728.353876] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 with Priority: HIGHEST for action security_group_rules [ 728.354030] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 with Priority: HIGHEST for action security_group_members [ 728.354500] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d06ad84-2e9d-4da2-b258-8ec3317a062a with Priority: HIGHEST for action port [ 728.354954] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e01edf8-56d4-4ad5-91cc-fcc882a409c8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.355121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.355291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.355506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.355682] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e01edf8-56d4-4ad5-91cc-fcc882a409c8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.357511] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.357664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.357712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.357871] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.358075] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.358212] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.358280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.358468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.358563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.358681] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e01edf8-56d4-4ad5-91cc-fcc882a409c8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.365966] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d06ad84-2e9d-4da2-b258-8ec3317a062a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.366171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d06ad84-2e9d-4da2-b258-8ec3317a062a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.366171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d06ad84-2e9d-4da2-b258-8ec3317a062a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.366449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d06ad84-2e9d-4da2-b258-8ec3317a062a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.366449] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d06ad84-2e9d-4da2-b258-8ec3317a062a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.727970] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.728246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.728332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.728663] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.728715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.729014] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 703826e2-1d66-436e-9721-f997727e26c4 is going to be updated. [ 728.767601] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.767839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.768223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.768336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.769000] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.783163] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: IN_PROGRESS for 2s [ 728.857954] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.858545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.868743] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e01edf8-56d4-4ad5-91cc-fcc882a409c8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.870461] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d06ad84-2e9d-4da2-b258-8ec3317a062a with status ACTIVE [ 728.870684] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.871066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.871066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.871436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.871436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.871436] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.872198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.872198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.872198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.872198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.872198] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.872198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.872198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.872537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.872537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.872537] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d06ad84-2e9d-4da2-b258-8ec3317a062a is going to be updated. [ 728.902231] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 in Status: SUCCESS [ 728.902789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.902789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.903106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.903372] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.903548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.903655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.903896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.904136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.904199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.904334] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cada3c1-366e-43a5-923b-57e235de0cb4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.908102] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.908308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.908420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.908694] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.908903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.909164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d06ad84-2e9d-4da2-b258-8ec3317a062a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.304700] env[65359]: INFO networking_nsxv3.common.synchronization [req-02a94acd-eb61-4f7b-84fb-f2da42e28d91 req-5bb67efb-5f92-41a6-bca2-4dba3a122be7 tempest-ListImageFiltersTestJSON-1057169836 tempest-ListImageFiltersTestJSON-1057169836-project-member] Enqueued Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_members [ 729.305290] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_members [ 729.305590] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.307366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.307533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.307838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.308048] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.308169] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.308233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.308416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.308504] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.308606] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.350854] env[65359]: INFO networking_nsxv3.common.synchronization [None req-dc301d41-f434-41d3-9e46-e7a71a9dd1da None None] Enqueued Resource ID: 1956a6c8-a956-4075-b387-2ebd5cab0659 with Priority: HIGHEST for action port [ 729.351591] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1956a6c8-a956-4075-b387-2ebd5cab0659 with Priority: HIGHEST for action port [ 729.353558] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-1956a6c8-a956-4075-b387-2ebd5cab0659 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.353558] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1956a6c8-a956-4075-b387-2ebd5cab0659" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.353558] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1956a6c8-a956-4075-b387-2ebd5cab0659" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.353558] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1956a6c8-a956-4075-b387-2ebd5cab0659" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.353558] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1956a6c8-a956-4075-b387-2ebd5cab0659',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.370740] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e01edf8-56d4-4ad5-91cc-fcc882a409c8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.409524] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cada3c1-366e-43a5-923b-57e235de0cb4 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.409524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.409524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.409524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.409524] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.409524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.409524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.409524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.409524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.409524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.409524] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cada3c1-366e-43a5-923b-57e235de0cb4 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.409524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.409524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.409524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.409524] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.409524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.410106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.410106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.410106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.410106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.410106] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cada3c1-366e-43a5-923b-57e235de0cb4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.697131] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.697391] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.697558] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.697872] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.698019] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.698173] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.698280] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.698480] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.698615] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.698810] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.698939] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.699036] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.699181] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.699289] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.699385] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.699508] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.727040] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.727040] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 729.727040] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.727040] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.727040] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-613e5509-af3e-4a55-b597-6e1ae67fb9aa taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.727040] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-613e5509-af3e-4a55-b597-6e1ae67fb9aa" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.727040] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-613e5509-af3e-4a55-b597-6e1ae67fb9aa" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.727040] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-613e5509-af3e-4a55-b597-6e1ae67fb9aa" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.727040] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('613e5509-af3e-4a55-b597-6e1ae67fb9aa',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.813938] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.813938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.813938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.813938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.813938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.813938] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.813938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.813938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.813938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.813938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.813938] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655ee501-2055-483e-a130-4cf497421bd3 already deleted. [ 729.813938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.854394] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1956a6c8-a956-4075-b387-2ebd5cab0659 [ 729.854678] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.854741] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.854771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.854992] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.855148] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.855199] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1956a6c8-a956-4075-b387-2ebd5cab0659 already deleted. [ 729.855278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1956a6c8-a956-4075-b387-2ebd5cab0659" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.874356] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.874551] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.874594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.874786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.874873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.874972] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 is going to be created. [ 729.902126] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.902384] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.902676] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.902755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.902895] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.915171] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 in Status: UNINITIALIZED for 2s [ 729.916605] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cada3c1-366e-43a5-923b-57e235de0cb4: rpc.has_security_group_logging(os_id): False [ 729.938176] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.938176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.938176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.938176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.938176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.938176] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.938176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.938176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.938176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.938176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.938176] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.938176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.938176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.938720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.938720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.938720] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.938720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.938720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.938989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.938989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.939051] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 is going to be created. [ 730.019947] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.020158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.020232] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.020454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.020632] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.035991] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 in Status: IN_PROGRESS for 2s [ 730.229071] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.229300] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.229407] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.229689] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.229835] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.229981] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 613e5509-af3e-4a55-b597-6e1ae67fb9aa not found, creating... [ 730.230259] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.230460] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.230573] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.230823] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.231073] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.231375] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.231527] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.231635] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.231838] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.231979] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.232125] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 613e5509-af3e-4a55-b597-6e1ae67fb9aa is going to be created. [ 730.256395] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.256651] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.256714] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.257113] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.257470] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.257713] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-613e5509-af3e-4a55-b597-6e1ae67fb9aa" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.804644] env[65359]: INFO networking_nsxv3.common.synchronization [req-f2938f52-7cca-4d3c-9944-c6de6ec00956 req-c125eae7-866b-4437-9ac9-4c87fa05431c tempest-AttachInterfacesUnderV243Test-943312976 tempest-AttachInterfacesUnderV243Test-943312976-project-member] Enqueued Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_members [ 730.805236] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_members [ 730.805636] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.805753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.808715] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: SUCCESS [ 730.808715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.808715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.808825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.809118] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.809284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.809326] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.809486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.809572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.809660] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.809759] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.811696] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.811696] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.811696] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.811696] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.811696] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.812032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.812032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.812032] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.826657] env[65359]: INFO networking_nsxv3.common.synchronization [req-f2938f52-7cca-4d3c-9944-c6de6ec00956 req-c125eae7-866b-4437-9ac9-4c87fa05431c tempest-AttachInterfacesUnderV243Test-943312976 tempest-AttachInterfacesUnderV243Test-943312976-project-member] Enqueued Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_rules [ 730.826657] env[65359]: INFO networking_nsxv3.common.synchronization [req-f2938f52-7cca-4d3c-9944-c6de6ec00956 req-c125eae7-866b-4437-9ac9-4c87fa05431c tempest-AttachInterfacesUnderV243Test-943312976 tempest-AttachInterfacesUnderV243Test-943312976-project-member] Enqueued Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_members [ 730.826657] env[65359]: INFO networking_nsxv3.common.synchronization [req-f2938f52-7cca-4d3c-9944-c6de6ec00956 req-c125eae7-866b-4437-9ac9-4c87fa05431c tempest-AttachInterfacesUnderV243Test-943312976 tempest-AttachInterfacesUnderV243Test-943312976-project-member] Enqueued Resource ID: 7a774f65-eb86-4cb0-9805-e0988c11cded with Priority: HIGHEST for action port [ 730.828573] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_rules [ 730.828730] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_members [ 730.828858] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a774f65-eb86-4cb0-9805-e0988c11cded with Priority: HIGHEST for action port [ 730.829310] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.829310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.829454] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.829529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.829716] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a774f65-eb86-4cb0-9805-e0988c11cded taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.829806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.829891] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.830144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.830231] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a774f65-eb86-4cb0-9805-e0988c11cded',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.059692] env[65359]: INFO networking_nsxv3.common.synchronization [req-02a94acd-eb61-4f7b-84fb-f2da42e28d91 req-77a05380-5fa2-49e2-a0f2-54ccc4fa5c2c service nova] Enqueued Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_rules [ 731.059891] env[65359]: INFO networking_nsxv3.common.synchronization [req-02a94acd-eb61-4f7b-84fb-f2da42e28d91 req-77a05380-5fa2-49e2-a0f2-54ccc4fa5c2c service nova] Enqueued Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_members [ 731.060023] env[65359]: INFO networking_nsxv3.common.synchronization [req-02a94acd-eb61-4f7b-84fb-f2da42e28d91 req-77a05380-5fa2-49e2-a0f2-54ccc4fa5c2c service nova] Enqueued Resource ID: 613e5509-af3e-4a55-b597-6e1ae67fb9aa with Priority: HIGHEST for action port [ 731.060627] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_rules [ 731.060774] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_members [ 731.060871] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 613e5509-af3e-4a55-b597-6e1ae67fb9aa with Priority: HIGHEST for action port [ 731.062614] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.062798] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.062861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.063311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.063387] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.064634] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.066171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.066291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.068411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.068411] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.068411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.068411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.068411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.068411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.068411] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.069600] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-613e5509-af3e-4a55-b597-6e1ae67fb9aa taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.070637] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-613e5509-af3e-4a55-b597-6e1ae67fb9aa" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.070776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-613e5509-af3e-4a55-b597-6e1ae67fb9aa" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.071672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-613e5509-af3e-4a55-b597-6e1ae67fb9aa" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.071672] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('613e5509-af3e-4a55-b597-6e1ae67fb9aa',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.315583] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.318906] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.336774] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a774f65-eb86-4cb0-9805-e0988c11cded with status ACTIVE [ 731.337173] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.338035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.338035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.338035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.338035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.338240] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.338240] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.338326] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.338655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.338655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.338885] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.339298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.339399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.339580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.339664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.339755] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a774f65-eb86-4cb0-9805-e0988c11cded is going to be updated. [ 731.379417] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.379582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.379648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.379954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.380883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.380883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a774f65-eb86-4cb0-9805-e0988c11cded" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.573363] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.574625] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.574782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.574970] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 613e5509-af3e-4a55-b597-6e1ae67fb9aa with status ACTIVE [ 731.575162] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.575313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.575406] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.575706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.575810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.577090] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.581025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.581025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.581025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.581025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.581663] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.581736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.581804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.582113] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.582148] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.582216] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 613e5509-af3e-4a55-b597-6e1ae67fb9aa is going to be updated. [ 731.641013] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.641256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.641336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.641550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.641691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.641859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-613e5509-af3e-4a55-b597-6e1ae67fb9aa" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.820525] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 703826e2-1d66-436e-9721-f997727e26c4: rpc.has_security_group_logging(os_id): False [ 731.822461] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.846164] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.846164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.846164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.846164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.846164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.846164] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.846164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.846164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.846164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.846164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.846164] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 703826e2-1d66-436e-9721-f997727e26c4 is going to be updated. [ 731.918318] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.918468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.918573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.918754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.918886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.932207] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 in Status: SUCCESS [ 731.932436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.932645] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.932815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.933043] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.933172] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.933262] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.933429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.933512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.933610] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.933686] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e01edf8-56d4-4ad5-91cc-fcc882a409c8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.939014] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: IN_PROGRESS for 2s [ 732.055312] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 in Status: SUCCESS [ 732.055631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.084828] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.325172] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.325449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.325449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.325666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.325766] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.325965] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 703826e2-1d66-436e-9721-f997727e26c4 is going to be updated. [ 732.360071] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.360231] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.360303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.361058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.361058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.377091] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: IN_PROGRESS for 2s [ 732.435832] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.436050] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.436112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.436369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.436567] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.436656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.436731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.436859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.436976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.437061] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.437189] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.437273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.437329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.437473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.437610] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.437698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.437816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.437914] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.437961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.438084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.438244] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e01edf8-56d4-4ad5-91cc-fcc882a409c8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.588017] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.588017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.588210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.588722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.588722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.588722] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655ee501-2055-483e-a130-4cf497421bd3 is going to be created. [ 732.622354] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.622534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.622573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.622782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.622928] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.639039] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: UNINITIALIZED for 2s [ 732.940542] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e01edf8-56d4-4ad5-91cc-fcc882a409c8: rpc.has_security_group_logging(os_id): False [ 732.960169] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.960649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.960649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.960739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.960767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.961122] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.961272] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.961359] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.961599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.961644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.961816] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.961975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.962469] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.962699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.962833] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.963095] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.963253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.963701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.963887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.964199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.964691] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 is going to be created. [ 733.028669] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.028828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.028900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.029214] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.029395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.041092] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 in Status: IN_PROGRESS for 2s [ 733.976731] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: SUCCESS [ 733.976731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.976731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.976731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.976731] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.390060] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: SUCCESS [ 734.390346] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.390535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.390758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.391154] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.391262] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.391338] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.391510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.391604] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.391706] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.479291] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.479493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.651160] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: SUCCESS [ 734.651388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.651561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.651777] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.651999] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.652124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.652182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.652344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.652411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.652493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.652587] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.895920] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.059210] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 in Status: SUCCESS [ 735.059210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.155798] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.155959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.156057] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.156954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.156954] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.156954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.156954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.156954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.157264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.157264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.157400] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.157522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.157583] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.157744] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.157897] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.158008] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.158081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.158230] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.158307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.158449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.158545] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.398266] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.661723] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 655ee501-2055-483e-a130-4cf497421bd3: rpc.has_security_group_logging(os_id): False [ 735.685709] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.685903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.685956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.686206] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.686303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.686523] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.686617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.686672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.687286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.687286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.687286] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.687286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.687286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.687708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.687708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.687708] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.687708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.687938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.687938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.687938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.688248] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 655ee501-2055-483e-a130-4cf497421bd3 is going to be created. [ 735.770739] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.771255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.771438] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.772419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.772734] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.790453] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: IN_PROGRESS for 2s [ 735.906938] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.906938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.907119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.907266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.907379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.907491] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 703826e2-1d66-436e-9721-f997727e26c4 is going to be updated. [ 735.947205] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.947434] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.947500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.947662] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.947818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.959871] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: IN_PROGRESS for 2s [ 736.063938] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 736.063938] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 736.143997] env[65359]: INFO networking_nsxv3.common.synchronization [req-e49e728f-2c6e-4083-a5c5-e9081b937578 req-905e44cf-7857-4f96-bfb0-46945c87f778 tempest-AttachInterfacesUnderV243Test-943312976 tempest-AttachInterfacesUnderV243Test-943312976-project-member] Enqueued Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_members [ 736.143997] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGHEST for action security_group_members [ 736.143997] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.146091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.850806] env[65359]: INFO networking_nsxv3.common.synchronization [req-b3ba4599-314f-4269-a381-1e2330cb910a req-72104314-812e-4988-9e46-fb6415039a93 tempest-ListImageFiltersTestJSON-1057169836 tempest-ListImageFiltersTestJSON-1057169836-project-member] Enqueued Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_members [ 736.850806] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_members [ 736.850806] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.850806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.850806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.850806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.850806] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.851578] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.851779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.852106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.852304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.852487] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.234916] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.234916] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.234916] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.234916] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.235395] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.235395] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.235534] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.236295] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.236295] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.236295] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.236295] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.236295] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.236295] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.236596] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.236596] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.236596] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.256766] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.256950] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 737.257098] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.257267] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.258035] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-0bad0195-13eb-4de3-abdb-0e191818d3c3 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.258035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-0bad0195-13eb-4de3-abdb-0e191818d3c3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.258035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-0bad0195-13eb-4de3-abdb-0e191818d3c3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.258240] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-0bad0195-13eb-4de3-abdb-0e191818d3c3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.258444] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bad0195-13eb-4de3-abdb-0e191818d3c3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.355963] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.389812] env[65359]: INFO networking_nsxv3.common.synchronization [None req-4eabeca2-b088-4db2-90a1-8979e8e3a079 None None] Enqueued Resource ID: 0fe4e8c3-17ef-4f0f-be88-41b588b45d43 with Priority: HIGHEST for action port [ 737.390845] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe4e8c3-17ef-4f0f-be88-41b588b45d43 with Priority: HIGHEST for action port [ 737.391368] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fe4e8c3-17ef-4f0f-be88-41b588b45d43 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.391566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fe4e8c3-17ef-4f0f-be88-41b588b45d43" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.391808] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fe4e8c3-17ef-4f0f-be88-41b588b45d43" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.392190] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fe4e8c3-17ef-4f0f-be88-41b588b45d43" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.392286] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fe4e8c3-17ef-4f0f-be88-41b588b45d43',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.763858] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.763858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.763858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.763858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.763858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.763858] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 0bad0195-13eb-4de3-abdb-0e191818d3c3 not found, creating... [ 737.763858] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.763858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.763858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.763858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.763858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.764830] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.765090] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.765247] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.765500] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.765645] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.765788] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 0bad0195-13eb-4de3-abdb-0e191818d3c3 is going to be created. [ 737.799213] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.799496] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.799750] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.800049] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.800331] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.800645] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-0bad0195-13eb-4de3-abdb-0e191818d3c3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.805871] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: SUCCESS [ 737.806299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.823047] env[65359]: INFO networking_nsxv3.common.synchronization [None req-bcd4686d-676b-4f69-b071-689a053d4aaa None None] Enqueued Resource ID: 336f6409-d0da-43ac-a5ba-3bf707c0170b with Priority: HIGHEST for action port [ 737.823254] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336f6409-d0da-43ac-a5ba-3bf707c0170b with Priority: HIGHEST for action port [ 737.823686] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-336f6409-d0da-43ac-a5ba-3bf707c0170b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.825046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-336f6409-d0da-43ac-a5ba-3bf707c0170b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.825142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-336f6409-d0da-43ac-a5ba-3bf707c0170b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.825499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-336f6409-d0da-43ac-a5ba-3bf707c0170b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.825621] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('336f6409-d0da-43ac-a5ba-3bf707c0170b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.857736] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.896610] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fe4e8c3-17ef-4f0f-be88-41b588b45d43 [ 737.896900] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.897101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.897193] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.897554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.897672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.897780] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fe4e8c3-17ef-4f0f-be88-41b588b45d43 already deleted. [ 737.897894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fe4e8c3-17ef-4f0f-be88-41b588b45d43" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.969477] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: SUCCESS [ 737.969758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.969947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.970179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.970377] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.970588] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.970588] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.970708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.970904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.970904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.971082] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.971937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.972214] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.973234] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.973234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.973234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.973234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.973234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.973234] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.328474] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 336f6409-d0da-43ac-a5ba-3bf707c0170b [ 738.328773] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.329846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.331248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.331544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.331623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.332349] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:336f6409-d0da-43ac-a5ba-3bf707c0170b already deleted. [ 738.332349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-336f6409-d0da-43ac-a5ba-3bf707c0170b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.360412] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.361083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.362561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.362561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.362561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.362561] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655ee501-2055-483e-a130-4cf497421bd3 is going to be updated. [ 738.402576] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.402839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.402935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.403249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.403447] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.419244] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: IN_PROGRESS for 2s [ 738.474906] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.476143] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.476294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.476397] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.476657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.476749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.476950] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.477070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.477486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.477682] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.477820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.477876] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 703826e2-1d66-436e-9721-f997727e26c4 is going to be updated. [ 738.531223] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.531404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.531502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.531773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.532081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.549878] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: IN_PROGRESS for 2s [ 738.634731] env[65359]: INFO networking_nsxv3.common.synchronization [req-b3ba4599-314f-4269-a381-1e2330cb910a req-2f692aa6-5f50-4e22-8ce6-cd2dc6c22d7b service nova] Enqueued Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_rules [ 738.634731] env[65359]: INFO networking_nsxv3.common.synchronization [req-b3ba4599-314f-4269-a381-1e2330cb910a req-2f692aa6-5f50-4e22-8ce6-cd2dc6c22d7b service nova] Enqueued Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_members [ 738.634731] env[65359]: INFO networking_nsxv3.common.synchronization [req-b3ba4599-314f-4269-a381-1e2330cb910a req-2f692aa6-5f50-4e22-8ce6-cd2dc6c22d7b service nova] Enqueued Resource ID: 0bad0195-13eb-4de3-abdb-0e191818d3c3 with Priority: HIGHEST for action port [ 738.635334] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_rules [ 738.635334] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_members [ 738.635334] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bad0195-13eb-4de3-abdb-0e191818d3c3 with Priority: HIGHEST for action port [ 738.635441] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.635554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.635617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.635829] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.635905] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.637825] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.637825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.637825] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bad0195-13eb-4de3-abdb-0e191818d3c3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.637825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bad0195-13eb-4de3-abdb-0e191818d3c3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.637825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bad0195-13eb-4de3-abdb-0e191818d3c3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.637825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bad0195-13eb-4de3-abdb-0e191818d3c3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.637825] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bad0195-13eb-4de3-abdb-0e191818d3c3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.980385] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 703826e2-1d66-436e-9721-f997727e26c4: rpc.has_security_group_logging(os_id): False [ 739.004517] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.004717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.004832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.005245] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.005429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.006434] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.008814] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.009026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.009317] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.009468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.009731] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 703826e2-1d66-436e-9721-f997727e26c4 is going to be updated. [ 739.086436] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.086662] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.086719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.086902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.087105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.106877] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: IN_PROGRESS for 2s [ 739.141023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.141023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.141023] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bad0195-13eb-4de3-abdb-0e191818d3c3 with status ACTIVE [ 739.141023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.141023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.141023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.142525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.142525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.142525] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.142525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.142525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.142525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.142525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.142781] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.142970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.143093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.143375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.143484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.143636] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bad0195-13eb-4de3-abdb-0e191818d3c3 is going to be updated. [ 739.188899] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.188899] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.188899] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.189423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.189423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.189423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bad0195-13eb-4de3-abdb-0e191818d3c3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.436199] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: SUCCESS [ 740.436199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.436199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.436199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.436199] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.436199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.436199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.436199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.436199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.436199] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.562219] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: SUCCESS [ 740.562421] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 703826e2-1d66-436e-9721-f997727e26c4 deletion is rescheduled due to dependency. [ 740.562552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.643677] env[65359]: INFO networking_nsxv3.common.synchronization [None req-6db8ab5e-e4e0-46f9-8a80-ecf4977b95e9 None None] Enqueued Resource ID: 3689c26c-599b-4abb-8841-1c4f8c2acdf9 with Priority: HIGHEST for action port [ 740.644359] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3689c26c-599b-4abb-8841-1c4f8c2acdf9 with Priority: HIGHEST for action port [ 740.644696] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-3689c26c-599b-4abb-8841-1c4f8c2acdf9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.644844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3689c26c-599b-4abb-8841-1c4f8c2acdf9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.644844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3689c26c-599b-4abb-8841-1c4f8c2acdf9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.646894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3689c26c-599b-4abb-8841-1c4f8c2acdf9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.646894] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3689c26c-599b-4abb-8841-1c4f8c2acdf9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.940209] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.125618] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 703826e2-1d66-436e-9721-f997727e26c4 in Status: SUCCESS [ 741.125618] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.149894] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3689c26c-599b-4abb-8841-1c4f8c2acdf9 [ 741.149894] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.149894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.149894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.149894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.149894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.149894] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3689c26c-599b-4abb-8841-1c4f8c2acdf9 already deleted. [ 741.149894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3689c26c-599b-4abb-8841-1c4f8c2acdf9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.443455] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.950625] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.950780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.950837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.951088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.951183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.951283] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655ee501-2055-483e-a130-4cf497421bd3 is going to be updated. [ 741.984859] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.985048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.985115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.985308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.985454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.997915] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: IN_PROGRESS for 2s [ 742.120682] env[65359]: INFO networking_nsxv3.common.synchronization [req-2b8bc9a3-d38e-4487-a180-ab9f0f563fa6 req-74bf5381-5901-4922-a168-61cfdd38e058 tempest-MigrationsAdminTest-860872539 tempest-MigrationsAdminTest-860872539-project-member] Enqueued Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_members [ 742.121301] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_members [ 742.121622] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.121752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.121819] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.122071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.122609] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.122609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.122609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.122758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.122758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.122862] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.568512] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.568860] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.568860] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.569213] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.569487] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.569647] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.569753] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.569970] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.570122] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.570330] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.570435] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.570544] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.570649] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.570795] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.570903] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.571086] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.590778] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.590909] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 742.591130] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.591320] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.591756] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.592033] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.592224] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.592593] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.592735] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.625334] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.746278] env[65359]: INFO networking_nsxv3.common.synchronization [None req-e53b7c82-078c-4d9e-9f53-d19cd9436e4c None None] Enqueued Resource ID: ba33cd3c-bedb-4213-a9b5-e611180355ca with Priority: HIGHEST for action port [ 742.746808] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba33cd3c-bedb-4213-a9b5-e611180355ca with Priority: HIGHEST for action port [ 742.747122] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba33cd3c-bedb-4213-a9b5-e611180355ca taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.747262] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba33cd3c-bedb-4213-a9b5-e611180355ca" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.747332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba33cd3c-bedb-4213-a9b5-e611180355ca" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.747588] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba33cd3c-bedb-4213-a9b5-e611180355ca" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.747757] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba33cd3c-bedb-4213-a9b5-e611180355ca',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.095459] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.095680] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.095797] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.096071] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.096217] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.096358] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b not found, creating... [ 743.096604] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.096779] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.096899] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.097130] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.097254] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.097829] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.097829] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.098265] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.098265] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.098400] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.098690] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b is going to be created. [ 743.121845] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.122103] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.122209] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.122466] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.122744] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.122979] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.127651] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.249949] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba33cd3c-bedb-4213-a9b5-e611180355ca [ 743.250230] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.250370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.250443] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.250673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.250771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.250868] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba33cd3c-bedb-4213-a9b5-e611180355ca already deleted. [ 743.250945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba33cd3c-bedb-4213-a9b5-e611180355ca" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.414113] env[65359]: INFO networking_nsxv3.common.synchronization [None req-1b7c0730-619b-4657-81a7-c02f7d264388 None None] Enqueued Resource ID: ec30e44e-44a9-4d9f-a0b7-6d738d019ec5 with Priority: HIGHEST for action port [ 743.416601] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec30e44e-44a9-4d9f-a0b7-6d738d019ec5 with Priority: HIGHEST for action port [ 743.416601] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec30e44e-44a9-4d9f-a0b7-6d738d019ec5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.416601] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec30e44e-44a9-4d9f-a0b7-6d738d019ec5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.416601] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec30e44e-44a9-4d9f-a0b7-6d738d019ec5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.416868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec30e44e-44a9-4d9f-a0b7-6d738d019ec5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.417180] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec30e44e-44a9-4d9f-a0b7-6d738d019ec5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.631043] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.631043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.631043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.631043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.631043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.631043] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09044820-85da-426b-b103-26678a0652e6 is going to be updated. [ 743.663841] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.663990] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.664088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.664247] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.664419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.675367] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: IN_PROGRESS for 2s [ 743.839396] env[65359]: INFO networking_nsxv3.common.synchronization [req-2b8bc9a3-d38e-4487-a180-ab9f0f563fa6 req-6a2ef2e3-fe89-4bd6-9746-f538a623a4e0 service nova] Enqueued Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_rules [ 743.839679] env[65359]: INFO networking_nsxv3.common.synchronization [req-2b8bc9a3-d38e-4487-a180-ab9f0f563fa6 req-6a2ef2e3-fe89-4bd6-9746-f538a623a4e0 service nova] Enqueued Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_members [ 743.839827] env[65359]: INFO networking_nsxv3.common.synchronization [req-2b8bc9a3-d38e-4487-a180-ab9f0f563fa6 req-6a2ef2e3-fe89-4bd6-9746-f538a623a4e0 service nova] Enqueued Resource ID: 4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b with Priority: HIGHEST for action port [ 743.840461] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_rules [ 743.840532] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_members [ 743.842069] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b with Priority: HIGHEST for action port [ 743.842226] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.842366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.842433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.842641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.842824] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.843640] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.843786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.843985] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.844117] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.844162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.844345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.844458] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.921606] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec30e44e-44a9-4d9f-a0b7-6d738d019ec5 [ 743.922532] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.922532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.922532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.922868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.922868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.922954] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec30e44e-44a9-4d9f-a0b7-6d738d019ec5 already deleted. [ 743.923027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec30e44e-44a9-4d9f-a0b7-6d738d019ec5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.009072] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: SUCCESS [ 744.009293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.009472] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.009691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.009905] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.010652] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.010779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.010932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.011093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.011244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.011386] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.348455] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.348644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.349756] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b with status ACTIVE [ 744.349756] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.349756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.349756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.349756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.349756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.349756] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.349756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.349756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.350459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.350459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.350459] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.350459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.350459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.350459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.350459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.350829] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b is going to be updated. [ 744.377043] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.377453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.377580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.377760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.377901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.378085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4af8d2c4-87e8-4ecd-afe0-58d4647b1a8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.410811] env[65359]: INFO networking_nsxv3.common.synchronization [req-124c4bc5-ddef-4e8c-b5ce-f31fe6fe85c4 req-43f00730-be73-429c-ac70-4cf7e0cc617c tempest-ServerGroupTestJSON-1328219482 tempest-ServerGroupTestJSON-1328219482-project-member] Enqueued Resource ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 with Priority: HIGHEST for action security_group_members [ 744.414965] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 with Priority: HIGHEST for action security_group_members [ 744.414965] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cada3c1-366e-43a5-923b-57e235de0cb4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.414965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.414965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.414965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.414965] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.414965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.414965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.414965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.414965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.414965] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cada3c1-366e-43a5-923b-57e235de0cb4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.514916] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.515238] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.516023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.516023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.516263] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.516418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.516529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.516802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.516963] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.517109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.517392] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.517556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.517670] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.517908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.519150] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.519277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.520270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.520270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.520270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.520270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.520270] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.915220] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.915220] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.915220] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.916278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.916278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.916278] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.916278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.916278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.916278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.916278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.916278] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 is going to be updated. [ 744.948695] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.948695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.948695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.948971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.948971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.960384] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 in Status: IN_PROGRESS for 2s [ 745.026200] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 655ee501-2055-483e-a130-4cf497421bd3: rpc.has_security_group_logging(os_id): False [ 745.052269] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.052480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.052643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.052721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.052815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.053042] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.053149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.053213] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.053372] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.053446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.053656] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.053759] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.053820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.053981] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.054072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.054274] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.054372] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.054438] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.054590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.054676] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.054774] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 655ee501-2055-483e-a130-4cf497421bd3 is going to be updated. [ 745.136868] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.137629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.137629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.137629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.137629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.156885] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: IN_PROGRESS for 2s [ 745.620136] env[65359]: INFO networking_nsxv3.common.synchronization [None req-29427370-cf9b-4997-9f04-d173d608ec92 None None] Enqueued Resource ID: 91cb6b47-0bf2-46b2-bd40-5f7facfb8ad0 with Priority: HIGHEST for action port [ 745.621252] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91cb6b47-0bf2-46b2-bd40-5f7facfb8ad0 with Priority: HIGHEST for action port [ 745.621252] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-91cb6b47-0bf2-46b2-bd40-5f7facfb8ad0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.621252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91cb6b47-0bf2-46b2-bd40-5f7facfb8ad0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.621702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91cb6b47-0bf2-46b2-bd40-5f7facfb8ad0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.623051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91cb6b47-0bf2-46b2-bd40-5f7facfb8ad0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.623155] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91cb6b47-0bf2-46b2-bd40-5f7facfb8ad0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.690559] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: SUCCESS [ 745.690559] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.690559] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.690559] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.692021] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.692021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.692021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.692021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.692312] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.692491] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.126961] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91cb6b47-0bf2-46b2-bd40-5f7facfb8ad0 [ 746.128127] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.128282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.128282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.128869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.128869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.128869] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91cb6b47-0bf2-46b2-bd40-5f7facfb8ad0 already deleted. [ 746.128869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91cb6b47-0bf2-46b2-bd40-5f7facfb8ad0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.197417] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.679095] env[65359]: INFO networking_nsxv3.common.synchronization [None req-eb5cd278-e42a-44e8-a648-74c9f9aaf17d None None] Enqueued Resource ID: fd777cd7-7447-4d39-9bc1-4682de576d56 with Priority: HIGHEST for action port [ 746.679095] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd777cd7-7447-4d39-9bc1-4682de576d56 with Priority: HIGHEST for action port [ 746.679354] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd777cd7-7447-4d39-9bc1-4682de576d56 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.679565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd777cd7-7447-4d39-9bc1-4682de576d56" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.679650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd777cd7-7447-4d39-9bc1-4682de576d56" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.679933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd777cd7-7447-4d39-9bc1-4682de576d56" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.680040] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd777cd7-7447-4d39-9bc1-4682de576d56',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.701388] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.980208] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 in Status: SUCCESS [ 746.980424] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 deletion is rescheduled due to dependency. [ 746.980547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.176630] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: SUCCESS [ 747.176630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.184321] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd777cd7-7447-4d39-9bc1-4682de576d56 [ 747.184321] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.184321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.184321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.184321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.184321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.184321] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd777cd7-7447-4d39-9bc1-4682de576d56 already deleted. [ 747.184321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd777cd7-7447-4d39-9bc1-4682de576d56" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.205088] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.205088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.205088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.205088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.205088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.205088] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09044820-85da-426b-b103-26678a0652e6 is going to be updated. [ 747.243893] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.244235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.244235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.244540] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.244540] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.258124] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: IN_PROGRESS for 2s [ 747.357245] env[65359]: INFO networking_nsxv3.common.synchronization [req-0c4aa64b-735e-47c2-9698-cce99c9d6e40 req-6effc1c7-a88e-406e-87a1-c49efc171fed tempest-ServerDiskConfigTestJSON-2085995032 tempest-ServerDiskConfigTestJSON-2085995032-project-member] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 747.358160] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 747.358711] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.358866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.359017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.359336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.359612] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.359802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.360138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.360213] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.360387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.360569] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.866270] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.866494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.866599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.866791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.866893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.867174] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.867363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.867363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.867570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.867613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.867722] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be updated. [ 747.920066] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.920267] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.920307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.921971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.921971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.933105] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: IN_PROGRESS for 2s [ 748.554079] env[65359]: INFO networking_nsxv3.common.synchronization [None req-758909df-9dbc-4763-a53a-755c4ce124b4 None None] Enqueued Resource ID: 28d2e08c-ad28-4fac-bfb6-636a5c2a13c5 with Priority: HIGHEST for action port [ 748.554079] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28d2e08c-ad28-4fac-bfb6-636a5c2a13c5 with Priority: HIGHEST for action port [ 748.554079] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-28d2e08c-ad28-4fac-bfb6-636a5c2a13c5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.554079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28d2e08c-ad28-4fac-bfb6-636a5c2a13c5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.554079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28d2e08c-ad28-4fac-bfb6-636a5c2a13c5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.554466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28d2e08c-ad28-4fac-bfb6-636a5c2a13c5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.554466] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28d2e08c-ad28-4fac-bfb6-636a5c2a13c5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.058129] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28d2e08c-ad28-4fac-bfb6-636a5c2a13c5 [ 749.058129] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.059956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.060294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.060526] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.060622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.060723] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28d2e08c-ad28-4fac-bfb6-636a5c2a13c5 already deleted. [ 749.060803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28d2e08c-ad28-4fac-bfb6-636a5c2a13c5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.274601] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: SUCCESS [ 749.274601] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.274795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.275013] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.275228] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.275342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.276956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.276956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.276956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.276956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.276956] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.523243] env[65359]: INFO networking_nsxv3.common.synchronization [req-a019fce0-07bf-4fed-8f22-432397f81f98 req-6f08187e-f770-4b40-9679-d2d7887de316 tempest-ImagesOneServerNegativeTestJSON-1491004073 tempest-ImagesOneServerNegativeTestJSON-1491004073-project-member] Enqueued Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 749.524292] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 749.524407] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.524486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.524585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.524796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.524960] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.525074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.525460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.525460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.525460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.525863] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.779638] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.779988] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.780124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.780352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.781111] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.781277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.781371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.781652] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.781802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.781964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.782258] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.782413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.782519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.782765] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.783007] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.783246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.783373] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.783601] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.783734] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.783872] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.784023] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.945416] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 749.945599] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b deletion is rescheduled due to dependency. [ 749.945775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.028503] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.028713] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.028772] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.028968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.029097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.029338] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.029448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.029512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.029693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.029852] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.029852] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 is going to be updated. [ 750.061025] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.061025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.061025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.061025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.061025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.071777] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: IN_PROGRESS for 2s [ 750.288434] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 09044820-85da-426b-b103-26678a0652e6: rpc.has_security_group_logging(os_id): False [ 750.311808] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.312035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.312096] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.312286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.312380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.312636] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.312758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.312798] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.312990] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.313102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.313308] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.313472] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.313545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.313704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.313805] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.315137] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.315303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.315387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.315577] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.315668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.315793] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09044820-85da-426b-b103-26678a0652e6 is going to be updated. [ 750.385359] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.387170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.387170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.387170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.387170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.398766] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: IN_PROGRESS for 2s [ 750.757028] env[65359]: INFO networking_nsxv3.common.synchronization [req-9005c4b2-a7f3-4216-bddb-0a3f283e2df3 req-37a91c82-f59d-4f23-8377-56e4ca731128 tempest-TenantUsagesTestJSON-1872062642 tempest-TenantUsagesTestJSON-1872062642-project-member] Enqueued Resource ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 with Priority: HIGHEST for action security_group_members [ 750.757028] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 with Priority: HIGHEST for action security_group_members [ 750.757028] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.757028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.757028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.758470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.758775] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.759028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.759265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.759545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.761409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.761409] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e01edf8-56d4-4ad5-91cc-fcc882a409c8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.263132] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.263132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.263554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.263554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.263615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.264168] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.264168] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.264168] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.264361] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.264361] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.264419] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 is going to be updated. [ 751.295774] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.295982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.296079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.296329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.296449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.307945] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 in Status: IN_PROGRESS for 2s [ 752.085261] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: SUCCESS [ 752.085470] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 deletion is rescheduled due to dependency. [ 752.085586] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.421882] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: SUCCESS [ 752.422643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.296044] env[65359]: INFO networking_nsxv3.common.synchronization [req-3e597911-e9f1-4886-902a-f4b635f22ff5 req-e3adb11e-dd1d-4eeb-887a-5105d0804594 tempest-ServersAdminNegativeTestJSON-660584843 tempest-ServersAdminNegativeTestJSON-660584843-project-member] Enqueued Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_members [ 753.296608] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_members [ 753.297467] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-582cfc14-9eeb-4704-a95a-052a5b40435e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.297717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.297795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.298290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.298490] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.298688] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.298778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.298951] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.299084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.299218] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.319079] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 in Status: SUCCESS [ 753.319296] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 deletion is rescheduled due to dependency. [ 753.319412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.801708] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.141360] env[65359]: INFO networking_nsxv3.common.synchronization [req-9e5d0ee0-f2ef-46ce-82d2-f0bccccb58f7 req-1a574b22-3bc7-462b-9501-ecb1c919bd71 tempest-ServerExternalEventsTest-862772880 tempest-ServerExternalEventsTest-862772880-project-member] Enqueued Resource ID: b74f2d49-4463-4031-b68b-ccef6e58b773 with Priority: HIGHEST for action security_group_members [ 754.141360] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b74f2d49-4463-4031-b68b-ccef6e58b773 with Priority: HIGHEST for action security_group_members [ 754.141639] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-b74f2d49-4463-4031-b68b-ccef6e58b773 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.142863] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.142863] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.142863] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.142863] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.142863] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.143364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.143364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.143364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.143364] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b74f2d49-4463-4031-b68b-ccef6e58b773',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.308805] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.652048] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.652048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.652048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.652048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.652048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.652048] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.652048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.652048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.652048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.652048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.652048] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b74f2d49-4463-4031-b68b-ccef6e58b773 already deleted. [ 754.652048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.749876] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.750155] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.750629] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.750629] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.750942] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.751105] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.751301] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.751699] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.752539] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.752539] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.752714] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.752871] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.752989] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.753959] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.753959] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.753959] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.777859] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.778036] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 754.778185] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.778360] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.778674] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-61831af4-fa2b-433c-b4c9-6aa46f62c784 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.778851] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-61831af4-fa2b-433c-b4c9-6aa46f62c784" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.778965] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-61831af4-fa2b-433c-b4c9-6aa46f62c784" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.779406] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-61831af4-fa2b-433c-b4c9-6aa46f62c784" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.779558] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61831af4-fa2b-433c-b4c9-6aa46f62c784',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.813021] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.813021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.813021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.813021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.813021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.813021] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 582cfc14-9eeb-4704-a95a-052a5b40435e is going to be updated. [ 754.844437] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.844701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.844701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.844873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.845025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.856820] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: IN_PROGRESS for 2s [ 755.282616] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.282940] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.283151] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.283577] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.283786] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.283994] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 61831af4-fa2b-433c-b4c9-6aa46f62c784 not found, creating... [ 755.284338] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.284559] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.284731] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.285017] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.285219] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.285641] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.285858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.286035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.286327] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.286576] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.286767] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 61831af4-fa2b-433c-b4c9-6aa46f62c784 is going to be created. [ 755.308398] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.308625] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.308716] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.308990] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.309345] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.309575] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-61831af4-fa2b-433c-b4c9-6aa46f62c784" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.035768] env[65359]: INFO networking_nsxv3.common.synchronization [req-9e5d0ee0-f2ef-46ce-82d2-f0bccccb58f7 req-9c8cb81a-3538-430d-bb90-7b8ab56b8bb7 service nova] Enqueued Resource ID: b74f2d49-4463-4031-b68b-ccef6e58b773 with Priority: HIGHEST for action security_group_rules [ 756.035768] env[65359]: INFO networking_nsxv3.common.synchronization [req-9e5d0ee0-f2ef-46ce-82d2-f0bccccb58f7 req-9c8cb81a-3538-430d-bb90-7b8ab56b8bb7 service nova] Enqueued Resource ID: b74f2d49-4463-4031-b68b-ccef6e58b773 with Priority: HIGHEST for action security_group_members [ 756.035768] env[65359]: INFO networking_nsxv3.common.synchronization [req-9e5d0ee0-f2ef-46ce-82d2-f0bccccb58f7 req-9c8cb81a-3538-430d-bb90-7b8ab56b8bb7 service nova] Enqueued Resource ID: 61831af4-fa2b-433c-b4c9-6aa46f62c784 with Priority: HIGHEST for action port [ 756.036994] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b74f2d49-4463-4031-b68b-ccef6e58b773 with Priority: HIGHEST for action security_group_rules [ 756.037362] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b74f2d49-4463-4031-b68b-ccef6e58b773 with Priority: HIGHEST for action security_group_members [ 756.037559] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61831af4-fa2b-433c-b4c9-6aa46f62c784 with Priority: HIGHEST for action port [ 756.037938] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b74f2d49-4463-4031-b68b-ccef6e58b773 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.038439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.038593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.038914] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.039123] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b74f2d49-4463-4031-b68b-ccef6e58b773',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.040306] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-b74f2d49-4463-4031-b68b-ccef6e58b773 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.041599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.041797] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.045556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.045556] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.045556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.045556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.045556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.045556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.045556] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b74f2d49-4463-4031-b68b-ccef6e58b773',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.045556] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-61831af4-fa2b-433c-b4c9-6aa46f62c784 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.045556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61831af4-fa2b-433c-b4c9-6aa46f62c784" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.045556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61831af4-fa2b-433c-b4c9-6aa46f62c784" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.045556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61831af4-fa2b-433c-b4c9-6aa46f62c784" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.045556] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61831af4-fa2b-433c-b4c9-6aa46f62c784',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.115150] env[65359]: INFO networking_nsxv3.common.synchronization [None req-fa49a17c-ba5c-4d01-9ccf-4baa81b60186 None None] Enqueued Resource ID: 39020502-0583-45f9-aba5-877e5a30f60c with Priority: HIGHEST for action port [ 756.115150] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39020502-0583-45f9-aba5-877e5a30f60c with Priority: HIGHEST for action port [ 756.115150] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-39020502-0583-45f9-aba5-877e5a30f60c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.115413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39020502-0583-45f9-aba5-877e5a30f60c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.115778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39020502-0583-45f9-aba5-877e5a30f60c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.116248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39020502-0583-45f9-aba5-877e5a30f60c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.116459] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39020502-0583-45f9-aba5-877e5a30f60c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.546538] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-b74f2d49-4463-4031-b68b-ccef6e58b773 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.546652] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.546868] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b74f2d49-4463-4031-b68b-ccef6e58b773',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.549016] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61831af4-fa2b-433c-b4c9-6aa46f62c784 with status ACTIVE [ 756.549016] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.549016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.549298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.549298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.549381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.549594] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.549702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.549763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.549927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.550609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.551582] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.551582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.551582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.551746] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.551826] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.551916] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61831af4-fa2b-433c-b4c9-6aa46f62c784 is going to be updated. [ 756.589137] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.589137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.589137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.589137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.589137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.589137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61831af4-fa2b-433c-b4c9-6aa46f62c784" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.621234] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39020502-0583-45f9-aba5-877e5a30f60c [ 756.621488] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.621626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.621828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.622589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.622589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.622589] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39020502-0583-45f9-aba5-877e5a30f60c already deleted. [ 756.622589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39020502-0583-45f9-aba5-877e5a30f60c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.877181] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: SUCCESS [ 756.877582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.050153] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b74f2d49-4463-4031-b68b-ccef6e58b773',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.552261] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.552555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.552555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.553040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.553040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.553146] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b74f2d49-4463-4031-b68b-ccef6e58b773 is going to be created. [ 757.578173] env[65359]: INFO networking_nsxv3.common.synchronization [req-fdcaf126-f7d4-45a3-b7bf-b5155ea0f9ab req-5e7cc12a-0a3e-4463-a766-ffaa1ab2e7f2 tempest-ServersWithSpecificFlavorTestJSON-1171930916 tempest-ServersWithSpecificFlavorTestJSON-1171930916-project-member] Enqueued Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_members [ 757.578173] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_members [ 757.578173] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.578173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.578173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.578173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.578173] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.578173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.578173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.578173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.578173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.578784] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.587380] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.587380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.587380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.587380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.587380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.598065] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b74f2d49-4463-4031-b68b-ccef6e58b773 in Status: UNINITIALIZED for 2s [ 758.081224] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.082163] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.082591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.082591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.082591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.082796] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.082919] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.082976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.083162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.083219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.083312] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 is going to be updated. [ 758.114226] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.115972] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.115972] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.115972] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.115972] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.125154] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 in Status: IN_PROGRESS for 2s [ 758.732612] env[65359]: INFO networking_nsxv3.common.synchronization [None req-5b160b8a-47bd-4a37-9116-2a88a46dfdb7 None None] Enqueued Resource ID: 7e36b389-334d-4175-969f-767b9238737c with Priority: HIGHEST for action port [ 758.733627] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e36b389-334d-4175-969f-767b9238737c with Priority: HIGHEST for action port [ 758.733864] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e36b389-334d-4175-969f-767b9238737c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.734033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e36b389-334d-4175-969f-767b9238737c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.734145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e36b389-334d-4175-969f-767b9238737c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.735603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e36b389-334d-4175-969f-767b9238737c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.735603] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e36b389-334d-4175-969f-767b9238737c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.243612] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e36b389-334d-4175-969f-767b9238737c [ 759.244523] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.244523] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.244523] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.244523] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.244762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.244762] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e36b389-334d-4175-969f-767b9238737c already deleted. [ 759.244880] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e36b389-334d-4175-969f-767b9238737c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.610202] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b74f2d49-4463-4031-b68b-ccef6e58b773 in Status: SUCCESS [ 759.610420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.610589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.610801] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.610994] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.611129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.611292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.611378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.611463] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.611554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.611642] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b74f2d49-4463-4031-b68b-ccef6e58b773',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.617961] env[65359]: INFO networking_nsxv3.common.synchronization [req-33b2e674-ce78-4d91-bd36-b26002fa36be req-fe18b888-c3a3-4e30-82b1-b3e274309311 tempest-ServersTestJSON-1097476844 tempest-ServersTestJSON-1097476844-project-member] Enqueued Resource ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 with Priority: HIGHEST for action security_group_members [ 759.618726] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 with Priority: HIGHEST for action security_group_members [ 759.619787] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.619970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.620087] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.620420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.620673] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.620831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.621516] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.621792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.621955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.622126] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.009701] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.009958] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.010635] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.010635] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.010974] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.011264] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.011382] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.011751] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.011813] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.012040] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.012182] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.012338] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.012446] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.012566] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.012685] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.012838] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.035082] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.035256] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 760.037229] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.037501] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.037650] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-fb29c5ab-c223-4398-b367-89f9c703c471 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.037832] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-fb29c5ab-c223-4398-b367-89f9c703c471" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.037937] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-fb29c5ab-c223-4398-b367-89f9c703c471" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.038304] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-fb29c5ab-c223-4398-b367-89f9c703c471" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.038423] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb29c5ab-c223-4398-b367-89f9c703c471',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.114631] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-b74f2d49-4463-4031-b68b-ccef6e58b773 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.114631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.114631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.114631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.114631] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.114838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.114838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.114894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.114975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.115865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.115865] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-b74f2d49-4463-4031-b68b-ccef6e58b773 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.115865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.115865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.115865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.115865] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.115865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.115865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.116292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.116292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.116292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.116292] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b74f2d49-4463-4031-b68b-ccef6e58b773',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.124481] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.124633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.124696] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.124882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.124982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.125161] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.125284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.125327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.125451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.125524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.125608] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 already deleted. [ 760.125764] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.140953] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 in Status: SUCCESS [ 760.140953] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 deletion is rescheduled due to dependency. [ 760.140953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.544908] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.545273] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.545273] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.545518] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.545681] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.545827] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port fb29c5ab-c223-4398-b367-89f9c703c471 not found, creating... [ 760.546507] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.546507] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.546507] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.546654] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.546700] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.546987] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.547348] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.547348] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.547451] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.547574] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.547707] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: fb29c5ab-c223-4398-b367-89f9c703c471 is going to be created. [ 760.571772] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.571982] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.572144] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.572429] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.572667] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.572892] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-fb29c5ab-c223-4398-b367-89f9c703c471" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.621791] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b74f2d49-4463-4031-b68b-ccef6e58b773: rpc.has_security_group_logging(os_id): False [ 760.643882] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.644053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.644130] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.644358] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.644454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.644666] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.644768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.644925] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.645142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.645239] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.645430] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.645527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.645590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.645730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.645804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.646019] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.646080] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.646139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.646274] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.646375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.646439] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b74f2d49-4463-4031-b68b-ccef6e58b773 is going to be created. [ 760.743377] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.743589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.743589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.743993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.744095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.758649] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b74f2d49-4463-4031-b68b-ccef6e58b773 in Status: IN_PROGRESS for 2s [ 761.366875] env[65359]: INFO networking_nsxv3.common.synchronization [req-33b2e674-ce78-4d91-bd36-b26002fa36be req-90825cdd-be7f-46fd-8b3f-3b68aa405c4c service nova] Enqueued Resource ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 with Priority: HIGHEST for action security_group_rules [ 761.367238] env[65359]: INFO networking_nsxv3.common.synchronization [req-33b2e674-ce78-4d91-bd36-b26002fa36be req-90825cdd-be7f-46fd-8b3f-3b68aa405c4c service nova] Enqueued Resource ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 with Priority: HIGHEST for action security_group_members [ 761.367389] env[65359]: INFO networking_nsxv3.common.synchronization [req-33b2e674-ce78-4d91-bd36-b26002fa36be req-90825cdd-be7f-46fd-8b3f-3b68aa405c4c service nova] Enqueued Resource ID: fb29c5ab-c223-4398-b367-89f9c703c471 with Priority: HIGHEST for action port [ 761.368019] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 with Priority: HIGHEST for action security_group_rules [ 761.368175] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 with Priority: HIGHEST for action security_group_members [ 761.368282] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb29c5ab-c223-4398-b367-89f9c703c471 with Priority: HIGHEST for action port [ 761.368999] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.369363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.369363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.369642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.369642] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.371370] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.371534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.371607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.372794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.373128] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.374240] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.374240] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.374240] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.374240] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.374240] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.375046] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb29c5ab-c223-4398-b367-89f9c703c471 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.375180] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb29c5ab-c223-4398-b367-89f9c703c471" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.375264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb29c5ab-c223-4398-b367-89f9c703c471" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.375448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb29c5ab-c223-4398-b367-89f9c703c471" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.377549] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb29c5ab-c223-4398-b367-89f9c703c471',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.877519] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.878539] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.878716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.878847] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb29c5ab-c223-4398-b367-89f9c703c471 with status ACTIVE [ 761.879020] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.879194] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.879294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.879515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.879632] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.879813] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.879936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.879991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.880186] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.880270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.880456] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.880581] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.880640] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.880783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.880883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.880985] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb29c5ab-c223-4398-b367-89f9c703c471 is going to be updated. [ 761.909918] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.910192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.910192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.910325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.910470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.910640] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb29c5ab-c223-4398-b367-89f9c703c471" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.383077] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.774689] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b74f2d49-4463-4031-b68b-ccef6e58b773 in Status: SUCCESS [ 762.775103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.885990] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.887306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.887306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.887306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.887306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.887306] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 is going to be created. [ 762.916551] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.916725] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.916803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.917039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.917323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.928556] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 in Status: UNINITIALIZED for 2s [ 763.116886] env[65359]: INFO networking_nsxv3.common.synchronization [req-c98cef6e-d2fe-437c-990f-771a6e5e01b0 req-cb53e264-24e3-4b90-92c8-80212f3719a7 tempest-ServersAdminTestJSON-387763736 tempest-ServersAdminTestJSON-387763736-project-member] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 763.117509] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 763.117912] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.118112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.118152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.118488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.118554] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.118636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.118735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.118964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.118964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.119097] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.319045] env[65359]: INFO networking_nsxv3.common.synchronization [req-795b80e8-b9d1-4137-b528-b843db7fea9b req-1c2621a6-5d5c-48e7-a196-dd13f91d26fd tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 with Priority: HIGHEST for action security_group_members [ 763.319045] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 with Priority: HIGHEST for action security_group_members [ 763.320209] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1f01646-6e50-4a59-a98b-3f8bba190b64 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.320386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.320456] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.320975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.321557] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.321748] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.322727] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.323142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.323318] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.323468] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1f01646-6e50-4a59-a98b-3f8bba190b64',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.596995] env[65359]: INFO networking_nsxv3.common.synchronization [req-0f345021-a3fa-48d5-94ea-5092492efb50 req-d78e551f-03e1-4a3c-8084-97fa76371c35 tempest-ListServersNegativeTestJSON-2074596717 tempest-ListServersNegativeTestJSON-2074596717-project-member] Enqueued Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 763.598189] env[65359]: INFO networking_nsxv3.common.synchronization [req-c41a06a4-5500-4dc9-986c-f738b0e6f675 req-ab8b3cca-2206-42a7-8d14-c6207b64cdc5 tempest-ListServersNegativeTestJSON-2074596717 tempest-ListServersNegativeTestJSON-2074596717-project-member] Enqueued Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 763.598705] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a4df49-7816-4678-be36-250c471235e3 with Priority: HIGHEST for action security_group_members [ 763.599021] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a4df49-7816-4678-be36-250c471235e3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.599176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.599246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.601141] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.601358] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.601476] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.603271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.603489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.603585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.603691] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a4df49-7816-4678-be36-250c471235e3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.622242] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.828161] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.828161] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.828260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.828455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.830556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.830556] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.830556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.830556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.830556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.830556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.830556] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 already deleted. [ 763.830556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.939034] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.939349] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.944119] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.944119] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.944119] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.944119] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.944119] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.944119] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.944119] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.944471] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.944471] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.944600] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.944763] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.944951] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.945158] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.945371] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.993836] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.994048] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 763.994202] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.994420] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.995680] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-e1224470-71e6-4d53-a59d-c0f38a184aa5 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.995680] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-e1224470-71e6-4d53-a59d-c0f38a184aa5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.995680] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-e1224470-71e6-4d53-a59d-c0f38a184aa5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.995680] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-e1224470-71e6-4d53-a59d-c0f38a184aa5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.995680] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1224470-71e6-4d53-a59d-c0f38a184aa5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.105916] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.106124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.106201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.106408] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.106715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.106715] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.106794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.106872] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.107008] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.107090] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.107175] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a4df49-7816-4678-be36-250c471235e3 is going to be updated. [ 764.124762] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.140294] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.140562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.140706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.141297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.142329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.154910] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: IN_PROGRESS for 2s [ 764.500020] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.500426] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.500661] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.501109] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.501340] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.501567] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port e1224470-71e6-4d53-a59d-c0f38a184aa5 not found, creating... [ 764.501976] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.502270] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.502540] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.502927] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.503158] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.503930] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.503930] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.503930] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.504158] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.504511] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.504511] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: e1224470-71e6-4d53-a59d-c0f38a184aa5 is going to be created. [ 764.529192] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.529435] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.529557] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.529856] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.530095] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.530378] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-e1224470-71e6-4d53-a59d-c0f38a184aa5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.630026] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.630026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.630026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.630026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.630026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.630026] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be updated. [ 764.676864] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.677537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.677725] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.678272] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.678272] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.695674] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 764.940685] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 in Status: SUCCESS [ 764.940946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.941162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.941463] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.941822] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.941822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.941822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.941980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.942113] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.942202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.942263] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.244643] env[65359]: INFO networking_nsxv3.common.synchronization [req-795b80e8-b9d1-4137-b528-b843db7fea9b req-4ebefef1-3b4f-4c4d-a62b-b1ad4e41f5b5 service nova] Enqueued Resource ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 with Priority: HIGHEST for action security_group_rules [ 765.244756] env[65359]: INFO networking_nsxv3.common.synchronization [req-795b80e8-b9d1-4137-b528-b843db7fea9b req-4ebefef1-3b4f-4c4d-a62b-b1ad4e41f5b5 service nova] Enqueued Resource ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 with Priority: HIGHEST for action security_group_members [ 765.244879] env[65359]: INFO networking_nsxv3.common.synchronization [req-795b80e8-b9d1-4137-b528-b843db7fea9b req-4ebefef1-3b4f-4c4d-a62b-b1ad4e41f5b5 service nova] Enqueued Resource ID: e1224470-71e6-4d53-a59d-c0f38a184aa5 with Priority: HIGHEST for action port [ 765.245636] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 with Priority: HIGHEST for action security_group_rules [ 765.245811] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 with Priority: HIGHEST for action security_group_members [ 765.245899] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1224470-71e6-4d53-a59d-c0f38a184aa5 with Priority: HIGHEST for action port [ 765.246228] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1f01646-6e50-4a59-a98b-3f8bba190b64 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.246373] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.246458] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.246684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.246776] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1f01646-6e50-4a59-a98b-3f8bba190b64',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.249428] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1f01646-6e50-4a59-a98b-3f8bba190b64 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.249625] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.249625] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.249795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.249989] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.250108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.250223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.250313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.250398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.250483] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1f01646-6e50-4a59-a98b-3f8bba190b64',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.251310] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1224470-71e6-4d53-a59d-c0f38a184aa5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.251419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1224470-71e6-4d53-a59d-c0f38a184aa5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.251487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1224470-71e6-4d53-a59d-c0f38a184aa5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.252190] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1224470-71e6-4d53-a59d-c0f38a184aa5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.252190] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1224470-71e6-4d53-a59d-c0f38a184aa5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.444200] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.749764] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1f01646-6e50-4a59-a98b-3f8bba190b64 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.750101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.754080] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1f01646-6e50-4a59-a98b-3f8bba190b64',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.755110] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1224470-71e6-4d53-a59d-c0f38a184aa5 with status ACTIVE [ 765.755315] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.755436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.755501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.755711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.755799] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.755967] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.756093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.756139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.756276] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.756345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.756517] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.756609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.756659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.756787] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.756856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.756925] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1224470-71e6-4d53-a59d-c0f38a184aa5 is going to be updated. [ 765.790032] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.790032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.790032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.790372] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.790450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.791039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1224470-71e6-4d53-a59d-c0f38a184aa5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.950258] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685: rpc.has_security_group_logging(os_id): False [ 765.971699] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.971699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.971699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.971699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.971699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.971699] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.971699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.971699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.971699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.971699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.971699] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 is going to be created. [ 766.035720] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.035895] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.035935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.036173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.036403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.051053] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 in Status: IN_PROGRESS for 2s [ 766.170526] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a4df49-7816-4678-be36-250c471235e3 in Status: SUCCESS [ 766.170733] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a4df49-7816-4678-be36-250c471235e3 deletion is rescheduled due to dependency. [ 766.170878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a4df49-7816-4678-be36-250c471235e3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.261154] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1f01646-6e50-4a59-a98b-3f8bba190b64',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.714826] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 766.715059] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.764390] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.764639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.764639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.764843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.764936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.765051] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 is going to be created. [ 766.806761] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.806942] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.807015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.807260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.807395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.821043] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 in Status: UNINITIALIZED for 2s [ 768.062534] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 in Status: SUCCESS [ 768.062877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.804154] env[65359]: INFO networking_nsxv3.common.synchronization [req-705bff4e-b010-45f1-82b7-aba3e427e348 req-85af29e7-5f0c-4e08-9a5f-1c96325ce150 tempest-ServerExternalEventsTest-862772880 tempest-ServerExternalEventsTest-862772880-project-member] Enqueued Resource ID: b74f2d49-4463-4031-b68b-ccef6e58b773 with Priority: HIGHEST for action security_group_members [ 768.804631] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b74f2d49-4463-4031-b68b-ccef6e58b773 with Priority: HIGHEST for action security_group_members [ 768.804952] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-b74f2d49-4463-4031-b68b-ccef6e58b773 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.805079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.805122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.805328] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.805492] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.805622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.805688] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.805938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.805938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.806034] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b74f2d49-4463-4031-b68b-ccef6e58b773',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.834131] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 in Status: SUCCESS [ 768.834400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.834943] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.835140] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.835338] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.835480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.835548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.835710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.835806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.835938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.836184] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1f01646-6e50-4a59-a98b-3f8bba190b64',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.313587] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.313909] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.313909] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.315187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.315556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.315632] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.315776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.315776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.315943] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.316050] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.316115] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b74f2d49-4463-4031-b68b-ccef6e58b773 is going to be updated. [ 769.339391] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1f01646-6e50-4a59-a98b-3f8bba190b64',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.345083] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.345083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.345083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.345083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.345083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.355708] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b74f2d49-4463-4031-b68b-ccef6e58b773 in Status: IN_PROGRESS for 2s [ 769.843263] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1f01646-6e50-4a59-a98b-3f8bba190b64: rpc.has_security_group_logging(os_id): False [ 769.868614] env[65359]: INFO networking_nsxv3.common.synchronization [req-2e34077e-1e81-4538-9292-c710546c5226 req-7875e9e5-0d46-4a6d-ad19-c3c6ea20ed8c tempest-ImagesTestJSON-1497561183 tempest-ImagesTestJSON-1497561183-project-member] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 769.869976] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 769.870338] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.870511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.870609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.870913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.871155] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.871323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.871429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.872875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.872875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.872875] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.874022] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.874149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.874222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.874403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.874782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.874782] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.874912] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.874912] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.875017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.875101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.875188] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 is going to be created. [ 769.958068] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.958261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.958304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.958538] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.958855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.974703] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 in Status: IN_PROGRESS for 2s [ 770.377833] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.378185] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.378185] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.378252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.378443] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.378723] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.378872] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.379102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.379175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.379233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.379651] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 770.409266] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.409477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.409622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.409839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.410024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.422220] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 770.580394] env[65359]: INFO networking_nsxv3.common.synchronization [None req-ee638b55-4391-4d65-86f2-276af2b0597e None None] Enqueued Resource ID: 48aaffea-e780-4075-8675-4a31d9406ffd with Priority: HIGHEST for action port [ 770.581082] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48aaffea-e780-4075-8675-4a31d9406ffd with Priority: HIGHEST for action port [ 770.581493] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-48aaffea-e780-4075-8675-4a31d9406ffd taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.582533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48aaffea-e780-4075-8675-4a31d9406ffd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.582983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48aaffea-e780-4075-8675-4a31d9406ffd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.582983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48aaffea-e780-4075-8675-4a31d9406ffd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.582983] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48aaffea-e780-4075-8675-4a31d9406ffd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.761089] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-189 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.761297] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.763557] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.763915] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.764241] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.764409] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.764570] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.764821] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.764960] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.765176] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.765280] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.765402] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.765611] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.765686] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.765783] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.765906] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.805669] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.805904] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 770.806103] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.806338] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.806787] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.807032] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.807197] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.807629] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.807810] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.085923] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48aaffea-e780-4075-8675-4a31d9406ffd [ 771.086180] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.086318] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.086394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.086624] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.086716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.086811] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48aaffea-e780-4075-8675-4a31d9406ffd already deleted. [ 771.086890] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48aaffea-e780-4075-8675-4a31d9406ffd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.311113] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.311468] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.311589] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.311906] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.312045] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.312176] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5 not found, creating... [ 771.312559] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.312740] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.312843] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.314927] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.314927] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.314927] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.314927] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.314927] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.314927] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.314927] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.314927] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5 is going to be created. [ 771.345698] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.345698] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.345698] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.345698] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.345698] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.346224] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.368741] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b74f2d49-4463-4031-b68b-ccef6e58b773 in Status: SUCCESS [ 771.368969] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b74f2d49-4463-4031-b68b-ccef6e58b773 deletion is rescheduled due to dependency. [ 771.369520] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.989325] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 in Status: SUCCESS [ 771.990105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.088948] env[65359]: INFO networking_nsxv3.common.synchronization [req-2e34077e-1e81-4538-9292-c710546c5226 req-d2ffdc15-e7ac-4c92-82a9-9d6daff2bb99 service nova] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_rules [ 772.089159] env[65359]: INFO networking_nsxv3.common.synchronization [req-2e34077e-1e81-4538-9292-c710546c5226 req-d2ffdc15-e7ac-4c92-82a9-9d6daff2bb99 service nova] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 772.089457] env[65359]: INFO networking_nsxv3.common.synchronization [req-2e34077e-1e81-4538-9292-c710546c5226 req-d2ffdc15-e7ac-4c92-82a9-9d6daff2bb99 service nova] Enqueued Resource ID: e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5 with Priority: HIGHEST for action port [ 772.090009] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_rules [ 772.091395] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 772.091395] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5 with Priority: HIGHEST for action port [ 772.092279] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.092416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.092518] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.092787] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.092913] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.097631] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.097631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.097631] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.097631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.097631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.097631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.097865] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.434290] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 772.434611] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 deletion is rescheduled due to dependency. [ 772.434801] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.435072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.435395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.435880] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.435880] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.436110] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.436618] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.437265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.437265] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.596116] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.596116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.601105] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5 with status ACTIVE [ 772.601105] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.601105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.601105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.601105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.601105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.601105] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.601105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.601105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.601105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.601105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.601105] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.601105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.601105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.601105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.601105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.601105] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5 is going to be updated. [ 772.633183] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.633183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.633183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.633183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.633183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.633183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0226e0d-9e3a-4b1d-8213-31cddaf2c8d5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.678732] env[65359]: INFO networking_nsxv3.common.synchronization [req-6052846e-aeab-4954-b78b-6ac19abca27a req-7ac653ea-79da-467e-bb57-2942fd1b1cd8 tempest-InstanceActionsV221TestJSON-732553247 tempest-InstanceActionsV221TestJSON-732553247-project-member] Enqueued Resource ID: 544e7b37-34ac-42c6-a973-4e3de7762947 with Priority: HIGHEST for action security_group_members [ 772.679593] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 544e7b37-34ac-42c6-a973-4e3de7762947 with Priority: HIGHEST for action security_group_members [ 772.679921] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-544e7b37-34ac-42c6-a973-4e3de7762947 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.680544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.680818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.680907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.681076] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.681187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.681387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.682596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.682596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.682596] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('544e7b37-34ac-42c6-a973-4e3de7762947',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.835641] env[65359]: INFO networking_nsxv3.common.synchronization [None req-e1e34ea1-ae36-4b1c-93cc-8456f4fa9892 None None] Enqueued Resource ID: 7ba02e90-3a65-4f07-9272-0c164ef505ff with Priority: HIGHEST for action port [ 772.838267] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ba02e90-3a65-4f07-9272-0c164ef505ff with Priority: HIGHEST for action port [ 772.839345] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ba02e90-3a65-4f07-9272-0c164ef505ff taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.839345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ba02e90-3a65-4f07-9272-0c164ef505ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.839496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ba02e90-3a65-4f07-9272-0c164ef505ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.839826] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ba02e90-3a65-4f07-9272-0c164ef505ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.839943] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ba02e90-3a65-4f07-9272-0c164ef505ff',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.940581] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.052169] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-103 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.052460] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-103" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.052521] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-103" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.052881] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-103" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.053154] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.053308] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.053421] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.053644] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.053794] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.053999] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.054727] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.054851] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.054961] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.055094] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.055198] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.055330] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.076613] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.076768] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 773.076849] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.076955] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-103" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.077275] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-7e701a37-e1d6-4e6f-be1b-8c386a2e7c04 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.077485] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-7e701a37-e1d6-4e6f-be1b-8c386a2e7c04" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.077555] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-7e701a37-e1d6-4e6f-be1b-8c386a2e7c04" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.077955] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-7e701a37-e1d6-4e6f-be1b-8c386a2e7c04" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.078123] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e701a37-e1d6-4e6f-be1b-8c386a2e7c04',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.184398] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.184590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.184664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.184894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.184990] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.188977] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.189135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.189243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.189405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.189494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.189585] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 544e7b37-34ac-42c6-a973-4e3de7762947 already deleted. [ 773.189668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.345386] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ba02e90-3a65-4f07-9272-0c164ef505ff [ 773.345386] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.345960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.346115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.346364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.346492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.346564] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ba02e90-3a65-4f07-9272-0c164ef505ff already deleted. [ 773.346654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ba02e90-3a65-4f07-9272-0c164ef505ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.445876] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.584901] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.584901] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.584901] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.584901] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.584901] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.584901] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 7e701a37-e1d6-4e6f-be1b-8c386a2e7c04 not found, creating... [ 773.584901] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.584901] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.584901] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.584901] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.584901] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.585421] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.585807] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.587904] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.587904] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.587904] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.587904] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 7e701a37-e1d6-4e6f-be1b-8c386a2e7c04 is going to be created. [ 773.615085] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.615313] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.615437] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.615717] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.616087] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.616370] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-7e701a37-e1d6-4e6f-be1b-8c386a2e7c04" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.948840] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.949069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.949169] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.949569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.949664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.949756] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 773.985725] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.985932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.985932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.986154] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.986299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.995248] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 774.378773] env[65359]: INFO networking_nsxv3.common.synchronization [req-6052846e-aeab-4954-b78b-6ac19abca27a req-7eb4cce4-c095-4f90-9d68-b02daef25025 service nova] Enqueued Resource ID: 544e7b37-34ac-42c6-a973-4e3de7762947 with Priority: HIGHEST for action security_group_rules [ 774.379064] env[65359]: INFO networking_nsxv3.common.synchronization [req-6052846e-aeab-4954-b78b-6ac19abca27a req-7eb4cce4-c095-4f90-9d68-b02daef25025 service nova] Enqueued Resource ID: 544e7b37-34ac-42c6-a973-4e3de7762947 with Priority: HIGHEST for action security_group_members [ 774.380237] env[65359]: INFO networking_nsxv3.common.synchronization [req-6052846e-aeab-4954-b78b-6ac19abca27a req-7eb4cce4-c095-4f90-9d68-b02daef25025 service nova] Enqueued Resource ID: 7e701a37-e1d6-4e6f-be1b-8c386a2e7c04 with Priority: HIGHEST for action port [ 774.380237] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 544e7b37-34ac-42c6-a973-4e3de7762947 with Priority: HIGHEST for action security_group_rules [ 774.380237] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 544e7b37-34ac-42c6-a973-4e3de7762947 with Priority: HIGHEST for action security_group_members [ 774.380496] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e701a37-e1d6-4e6f-be1b-8c386a2e7c04 with Priority: HIGHEST for action port [ 774.380618] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-544e7b37-34ac-42c6-a973-4e3de7762947 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.380752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.380822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.381088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.381171] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('544e7b37-34ac-42c6-a973-4e3de7762947',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.382747] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-544e7b37-34ac-42c6-a973-4e3de7762947 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.382857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.382916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.383108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.383260] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.383356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.383419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.383564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.383671] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.383763] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('544e7b37-34ac-42c6-a973-4e3de7762947',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.385311] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e701a37-e1d6-4e6f-be1b-8c386a2e7c04 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.385422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e701a37-e1d6-4e6f-be1b-8c386a2e7c04" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.385481] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e701a37-e1d6-4e6f-be1b-8c386a2e7c04" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.385631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e701a37-e1d6-4e6f-be1b-8c386a2e7c04" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.385719] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e701a37-e1d6-4e6f-be1b-8c386a2e7c04',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.509321] env[65359]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 774.509453] env[65359]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] NSXv3 Agent Agent loop - iteration:1 started [ 774.884701] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-544e7b37-34ac-42c6-a973-4e3de7762947 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.885188] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.885633] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('544e7b37-34ac-42c6-a973-4e3de7762947',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.888631] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e701a37-e1d6-4e6f-be1b-8c386a2e7c04 with status ACTIVE [ 774.889048] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.889516] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.889676] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.889980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.890451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.890833] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.891080] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.891234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.891539] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.891784] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.892155] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.892731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.893738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.895129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.895129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.895129] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e701a37-e1d6-4e6f-be1b-8c386a2e7c04 is going to be updated. [ 774.925023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.925184] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.925257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.925562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.925608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.925769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e701a37-e1d6-4e6f-be1b-8c386a2e7c04" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.397551] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('544e7b37-34ac-42c6-a973-4e3de7762947',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.903120] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.903120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.903120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.903120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.903120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.903120] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 544e7b37-34ac-42c6-a973-4e3de7762947 is going to be created. [ 775.928221] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.928221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.928221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.928221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.928221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.937496] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 544e7b37-34ac-42c6-a973-4e3de7762947 in Status: UNINITIALIZED for 2s [ 776.006806] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 776.009022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.009022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.009022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.009022] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.009022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.009022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.009022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.009022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.009022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.009022] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.513166] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.513845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.513845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.514024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.514243] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.514466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.514680] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.515046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.515123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.515288] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.515552] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.515766] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.515971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.516776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.517018] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.517147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.517247] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.517454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.517543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.517597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.517708] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.024633] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28737c44-388f-4cb8-9cac-0181cbb28981: rpc.has_security_group_logging(os_id): False [ 777.044540] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.044540] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.044540] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.044793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.044793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.044894] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.045068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.045068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.045825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.045825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.045825] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.045825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.045825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.045825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.046134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.046343] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.046697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.046771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.048091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.048091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.048091] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 777.122282] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.122282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.122282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.122282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.122282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.138048] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 777.949581] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 544e7b37-34ac-42c6-a973-4e3de7762947 in Status: SUCCESS [ 777.950015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.950197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.952092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.952092] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.952092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.952092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.952092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.952092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.952092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.952092] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('544e7b37-34ac-42c6-a973-4e3de7762947',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.454913] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-544e7b37-34ac-42c6-a973-4e3de7762947 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.455179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.455773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.455773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.455773] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.460100] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.460260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.460545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.460683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.460771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.460996] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-544e7b37-34ac-42c6-a973-4e3de7762947 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.461126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.462201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.462201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.462201] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.462201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.462201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.462201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.462201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.462602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.462661] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('544e7b37-34ac-42c6-a973-4e3de7762947',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.966504] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 544e7b37-34ac-42c6-a973-4e3de7762947: rpc.has_security_group_logging(os_id): False [ 778.989746] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.990334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.990334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.990334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.990334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.990508] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.990576] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.990984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.990984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.990984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.991161] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.991268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.991335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.991503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.991597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.991796] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.991880] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.991977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.992081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.992176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.992330] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 544e7b37-34ac-42c6-a973-4e3de7762947 is going to be created. [ 779.059517] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.059687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.059738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.059947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.060149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.072275] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 544e7b37-34ac-42c6-a973-4e3de7762947 in Status: IN_PROGRESS for 2s [ 779.154569] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 779.155046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.381086] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 779.381204] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 779.915901] env[65359]: INFO networking_nsxv3.common.synchronization [req-02acde38-8815-4b2e-9020-2bcaf637a294 req-2168c343-5453-4030-bbe9-4fc732d92202 tempest-AttachVolumeTestJSON-1956829346 tempest-AttachVolumeTestJSON-1956829346-project-member] Enqueued Resource ID: 52365fff-e017-4d11-ba53-f5893d863536 with Priority: HIGHEST for action security_group_members [ 779.916655] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52365fff-e017-4d11-ba53-f5893d863536 with Priority: HIGHEST for action security_group_members [ 779.916785] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-52365fff-e017-4d11-ba53-f5893d863536 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.917176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.917176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.918966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.919204] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.921051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.921051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.921051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.921051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.921051] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52365fff-e017-4d11-ba53-f5893d863536',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.334717] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-730 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.335051] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-730" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.335138] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-730" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.335490] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-730" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.335644] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.335791] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.335898] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.336307] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.336505] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.336734] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.336828] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.336931] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.337050] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.337255] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.337255] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.337389] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.358836] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.359015] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 780.359158] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.359469] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-730" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.360114] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-7a58a4a7-0bef-41c2-b33a-6c907f468fd9 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.360114] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-7a58a4a7-0bef-41c2-b33a-6c907f468fd9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.360114] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-7a58a4a7-0bef-41c2-b33a-6c907f468fd9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.360479] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-7a58a4a7-0bef-41c2-b33a-6c907f468fd9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.360761] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a58a4a7-0bef-41c2-b33a-6c907f468fd9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.394036] env[65359]: INFO networking_nsxv3.common.synchronization [None req-3d9b2216-98a3-4fcd-975b-705a2a6a8a17 None None] Enqueued Resource ID: baeb7dc0-92ac-47e2-bca8-3133c69cb932 with Priority: HIGHEST for action port [ 780.394591] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baeb7dc0-92ac-47e2-bca8-3133c69cb932 with Priority: HIGHEST for action port [ 780.394926] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-baeb7dc0-92ac-47e2-bca8-3133c69cb932 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.395088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-baeb7dc0-92ac-47e2-bca8-3133c69cb932" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.395172] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-baeb7dc0-92ac-47e2-bca8-3133c69cb932" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.395705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-baeb7dc0-92ac-47e2-bca8-3133c69cb932" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.395705] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baeb7dc0-92ac-47e2-bca8-3133c69cb932',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.421750] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.422151] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.422321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.422642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.422845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.423192] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.423520] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.423741] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.423987] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.424170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.424341] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52365fff-e017-4d11-ba53-f5893d863536 already deleted. [ 780.424531] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.863905] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.864195] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.864321] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.864588] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.864731] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.864878] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 7a58a4a7-0bef-41c2-b33a-6c907f468fd9 not found, creating... [ 780.865184] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.865338] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.865454] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.865662] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.865792] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.866081] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.866231] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.866342] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.866686] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.866686] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.866796] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 7a58a4a7-0bef-41c2-b33a-6c907f468fd9 is going to be created. [ 780.892381] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.892381] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.893164] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.893164] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.893262] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.893675] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-7a58a4a7-0bef-41c2-b33a-6c907f468fd9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.897507] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port baeb7dc0-92ac-47e2-bca8-3133c69cb932 [ 780.897626] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.897760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.897820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.898675] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.898675] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.898675] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:baeb7dc0-92ac-47e2-bca8-3133c69cb932 already deleted. [ 780.898675] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-baeb7dc0-92ac-47e2-bca8-3133c69cb932" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.088325] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 544e7b37-34ac-42c6-a973-4e3de7762947 in Status: SUCCESS [ 781.088565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.704990] env[65359]: INFO networking_nsxv3.common.synchronization [req-02acde38-8815-4b2e-9020-2bcaf637a294 req-61ce7f91-2bea-4fa7-a353-31b2ee11f6fe service nova] Enqueued Resource ID: 52365fff-e017-4d11-ba53-f5893d863536 with Priority: HIGHEST for action security_group_rules [ 781.704990] env[65359]: INFO networking_nsxv3.common.synchronization [req-02acde38-8815-4b2e-9020-2bcaf637a294 req-61ce7f91-2bea-4fa7-a353-31b2ee11f6fe service nova] Enqueued Resource ID: 52365fff-e017-4d11-ba53-f5893d863536 with Priority: HIGHEST for action security_group_members [ 781.704990] env[65359]: INFO networking_nsxv3.common.synchronization [req-02acde38-8815-4b2e-9020-2bcaf637a294 req-61ce7f91-2bea-4fa7-a353-31b2ee11f6fe service nova] Enqueued Resource ID: 7a58a4a7-0bef-41c2-b33a-6c907f468fd9 with Priority: HIGHEST for action port [ 781.705631] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52365fff-e017-4d11-ba53-f5893d863536 with Priority: HIGHEST for action security_group_rules [ 781.705631] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52365fff-e017-4d11-ba53-f5893d863536 with Priority: HIGHEST for action security_group_members [ 781.705631] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a58a4a7-0bef-41c2-b33a-6c907f468fd9 with Priority: HIGHEST for action port [ 781.709195] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52365fff-e017-4d11-ba53-f5893d863536 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.709195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.709195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.709195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.709195] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52365fff-e017-4d11-ba53-f5893d863536',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.709195] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-52365fff-e017-4d11-ba53-f5893d863536 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.709195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.709195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.709195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.709195] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.709195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.709195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.709195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.709195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.709195] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52365fff-e017-4d11-ba53-f5893d863536',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.709846] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a58a4a7-0bef-41c2-b33a-6c907f468fd9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.711634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a58a4a7-0bef-41c2-b33a-6c907f468fd9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.711634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a58a4a7-0bef-41c2-b33a-6c907f468fd9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.711634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a58a4a7-0bef-41c2-b33a-6c907f468fd9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.711634] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a58a4a7-0bef-41c2-b33a-6c907f468fd9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.044038] env[65359]: INFO networking_nsxv3.common.synchronization [None req-08cc7def-619d-4cee-af20-709ccfdeaa88 tempest-ServersTestManualDisk-1454548057 tempest-ServersTestManualDisk-1454548057-project-member] Enqueued Resource ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 with Priority: HIGHEST for action security_group_rules [ 782.044038] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 with Priority: HIGHEST for action security_group_rules [ 782.044038] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.044038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.044038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.044038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.044038] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3711d124-9bf8-4fa4-9c53-ee6c21e9b344',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.146542] env[65359]: INFO networking_nsxv3.common.synchronization [None req-b84ad3c9-53f5-480a-bed4-027f5eee3e94 tempest-ServersTestManualDisk-1454548057 tempest-ServersTestManualDisk-1454548057-project-member] Enqueued Resource ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 with Priority: HIGHEST for action security_group_rules [ 782.147993] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 with Priority: HIGHEST for action security_group_rules [ 782.148888] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.149014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.213037] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-52365fff-e017-4d11-ba53-f5893d863536 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.213037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.213037] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52365fff-e017-4d11-ba53-f5893d863536',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.214222] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a58a4a7-0bef-41c2-b33a-6c907f468fd9 with status ACTIVE [ 782.214321] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.214432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.214537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.214791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.214967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.217368] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.217368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.217368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.217668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.217769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.218056] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.218585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.218736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.218934] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.219165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.219165] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a58a4a7-0bef-41c2-b33a-6c907f468fd9 is going to be updated. [ 782.264235] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.264479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.264479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.265083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.265083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.265083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a58a4a7-0bef-41c2-b33a-6c907f468fd9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.573171] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.573171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.573171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.573171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.573171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.573171] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 already deleted. [ 782.573171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.573171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.573171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.573171] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3711d124-9bf8-4fa4-9c53-ee6c21e9b344',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.723715] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52365fff-e017-4d11-ba53-f5893d863536',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.008781] env[65359]: INFO networking_nsxv3.common.synchronization [None req-edea25e4-772b-4f9e-a4e3-b09ce717624b None None] Enqueued Resource ID: 30802878-79fa-4cee-83eb-73083cfb44db with Priority: HIGHEST for action port [ 783.010492] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30802878-79fa-4cee-83eb-73083cfb44db with Priority: HIGHEST for action port [ 783.010888] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-30802878-79fa-4cee-83eb-73083cfb44db taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.011053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30802878-79fa-4cee-83eb-73083cfb44db" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.011129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30802878-79fa-4cee-83eb-73083cfb44db" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.011384] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30802878-79fa-4cee-83eb-73083cfb44db" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.011494] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30802878-79fa-4cee-83eb-73083cfb44db',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.102661] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.102821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.102889] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.103118] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.103207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.106024] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 already deleted. [ 783.106024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.197759] env[65359]: INFO networking_nsxv3.common.synchronization [req-d80535c8-ff20-44ae-be2b-1445affc9e7a req-e4165cce-02d7-414b-aff3-5dcebf93381a tempest-ServersTestMultiNic-532988977 tempest-ServersTestMultiNic-532988977-project-member] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 783.199039] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 783.199039] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.199262] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.199319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.199643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.199852] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.199981] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.200071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.200307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.200470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.200589] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.226780] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.226963] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.227266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.227266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.227409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.227409] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52365fff-e017-4d11-ba53-f5893d863536 is going to be created. [ 783.290085] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.290465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.290668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.290969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.291287] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.307261] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52365fff-e017-4d11-ba53-f5893d863536 in Status: UNINITIALIZED for 2s [ 783.515341] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30802878-79fa-4cee-83eb-73083cfb44db [ 783.515341] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.515341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.515341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.515788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.515788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.516724] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30802878-79fa-4cee-83eb-73083cfb44db already deleted. [ 783.516833] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30802878-79fa-4cee-83eb-73083cfb44db" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.617696] env[65359]: INFO networking_nsxv3.common.synchronization [req-d80535c8-ff20-44ae-be2b-1445affc9e7a req-526a0067-6785-49c0-8b92-e4cb979d73da tempest-ServersTestMultiNic-532988977 tempest-ServersTestMultiNic-532988977-project-member] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 783.618333] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 783.619339] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.619494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.624444] env[65359]: INFO networking_nsxv3.common.synchronization [None req-ee10c513-a821-47ff-af2a-8fc1a6e2e506 tempest-ServerActionsTestJSON-975876043 tempest-ServerActionsTestJSON-975876043-project-member] Enqueued Resource ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d with Priority: HIGHEST for action security_group_rules [ 783.624970] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d with Priority: HIGHEST for action security_group_rules [ 783.625333] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.625441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.625493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.625756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.625865] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.704730] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.704730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.704730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.704730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.704730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.704730] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.704730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.704730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.704730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.704730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.705218] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b already deleted. [ 783.705218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.705218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.705392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.705457] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.705529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.705562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.705691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.705779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.705860] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.765030] env[65359]: INFO networking_nsxv3.common.synchronization [None req-89bc77bc-77e3-4e29-854e-7a6f6c6cd19f tempest-ServerActionsTestJSON-975876043 tempest-ServerActionsTestJSON-975876043-project-member] Enqueued Resource ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d with Priority: HIGHEST for action security_group_rules [ 783.765030] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d with Priority: HIGHEST for action security_group_rules [ 783.766460] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.766460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.981865] env[65359]: INFO networking_nsxv3.common.synchronization [req-d80535c8-ff20-44ae-be2b-1445affc9e7a req-e0049b16-24d8-40eb-89ac-ca64a7bdb5f4 tempest-ServersTestMultiNic-532988977 tempest-ServersTestMultiNic-532988977-project-member] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 783.981865] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 783.983268] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.983405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.152883] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.153070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.153143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.153423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.153541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.153644] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d already deleted. [ 784.153769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.153940] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.154252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.154252] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.212092] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.212092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.212092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.212092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.212092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.212092] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.212092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.212092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.212092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.212092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.212092] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b already deleted. [ 784.212092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.212092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.212092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.212092] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.212092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.212092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.212092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.212902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.212902] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.450032] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-679 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.450184] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-679" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.451153] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-679" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.451153] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-679" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.451153] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.451153] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.451153] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.452342] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.452342] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.452342] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 784.452342] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.452342] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.452342] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.452342] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 784.452342] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.452579] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.474603] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.474823] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 784.474997] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.475211] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-679" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.475613] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-ab1ac09b-f9f4-43c0-be30-d876949b381e taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.475850] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-ab1ac09b-f9f4-43c0-be30-d876949b381e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.475994] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-ab1ac09b-f9f4-43c0-be30-d876949b381e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.476360] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-ab1ac09b-f9f4-43c0-be30-d876949b381e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.476534] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab1ac09b-f9f4-43c0-be30-d876949b381e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.680066] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.680066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.680066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.680066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.680066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.680066] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d already deleted. [ 784.680066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.719367] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.719367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.719367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.719367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.719367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.719367] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.719367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.719367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.719846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.719846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.719846] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b already deleted. [ 784.719846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.979187] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.979778] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.979778] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.979936] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.979973] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.980164] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port ab1ac09b-f9f4-43c0-be30-d876949b381e not found, creating... [ 784.980444] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.980607] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.980719] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.980962] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.981111] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.981539] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.981650] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.981756] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.981964] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.982127] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.982267] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: ab1ac09b-f9f4-43c0-be30-d876949b381e is going to be created. [ 785.009459] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.009723] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.009876] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.010460] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.010460] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.010632] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-ab1ac09b-f9f4-43c0-be30-d876949b381e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.322021] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52365fff-e017-4d11-ba53-f5893d863536 in Status: SUCCESS [ 785.322244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.322388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.322667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.322887] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.323025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.323086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.326291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.326291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.326291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.326291] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52365fff-e017-4d11-ba53-f5893d863536',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.561922] env[65359]: INFO networking_nsxv3.common.synchronization [req-bf99695b-1fa3-4f2b-bbd0-5538c782ec9c req-d88835eb-a0bb-4e96-8e89-8eb22022c3f0 tempest-ServersTestJSON-1929866617 tempest-ServersTestJSON-1929866617-project-member] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 785.562454] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 785.562796] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.562883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.562948] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.563154] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.563359] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.564502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.564817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.565068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.565668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.565798] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.769299] env[65359]: INFO networking_nsxv3.common.synchronization [req-d80535c8-ff20-44ae-be2b-1445affc9e7a req-fc21e29f-8dfb-4516-9ba0-05b952d9df54 service nova] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_rules [ 785.769299] env[65359]: INFO networking_nsxv3.common.synchronization [req-d80535c8-ff20-44ae-be2b-1445affc9e7a req-fc21e29f-8dfb-4516-9ba0-05b952d9df54 service nova] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 785.769299] env[65359]: INFO networking_nsxv3.common.synchronization [req-d80535c8-ff20-44ae-be2b-1445affc9e7a req-fc21e29f-8dfb-4516-9ba0-05b952d9df54 service nova] Enqueued Resource ID: ab1ac09b-f9f4-43c0-be30-d876949b381e with Priority: HIGHEST for action port [ 785.769299] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_rules [ 785.769299] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 785.769299] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab1ac09b-f9f4-43c0-be30-d876949b381e with Priority: HIGHEST for action port [ 785.769299] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.769299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.769299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.769299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.769299] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.770996] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.771264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.771464] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.774018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.774018] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.774018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.774018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.774018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.774018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.774018] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.774018] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab1ac09b-f9f4-43c0-be30-d876949b381e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.774018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab1ac09b-f9f4-43c0-be30-d876949b381e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.774018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab1ac09b-f9f4-43c0-be30-d876949b381e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.774018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab1ac09b-f9f4-43c0-be30-d876949b381e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.774677] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab1ac09b-f9f4-43c0-be30-d876949b381e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.827759] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52365fff-e017-4d11-ba53-f5893d863536',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.928219] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.928219] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.928219] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.928219] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.928219] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.928219] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.928219] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.928219] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.928661] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.928661] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.928661] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.928844] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.928900] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.929026] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.929144] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.929379] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.950574] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.950765] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.950920] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.951148] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.951508] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-bcb6f871-28e6-4f3e-b907-5d833f06bd12 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.951689] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-bcb6f871-28e6-4f3e-b907-5d833f06bd12" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.951831] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-bcb6f871-28e6-4f3e-b907-5d833f06bd12" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.952198] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-bcb6f871-28e6-4f3e-b907-5d833f06bd12" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.952358] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb6f871-28e6-4f3e-b907-5d833f06bd12',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.069395] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.279056] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.279056] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.279056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.281670] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab1ac09b-f9f4-43c0-be30-d876949b381e with status ACTIVE [ 786.281941] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.282104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.282171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.282390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.282480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.282665] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.282763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.282990] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.283068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.283099] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.283280] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.283415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.283448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.283666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.283666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.283741] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab1ac09b-f9f4-43c0-be30-d876949b381e is going to be updated. [ 786.313856] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.313856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.313856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.313856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.313856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.313856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab1ac09b-f9f4-43c0-be30-d876949b381e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.330257] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52365fff-e017-4d11-ba53-f5893d863536: rpc.has_security_group_logging(os_id): False [ 786.357155] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.357444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.357444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.357578] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.357732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.357914] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.358041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.358084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.358242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.358414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.358568] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52365fff-e017-4d11-ba53-f5893d863536 is going to be created. [ 786.459080] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.459292] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.459457] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.459763] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.459866] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.460039] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port bcb6f871-28e6-4f3e-b907-5d833f06bd12 not found, creating... [ 786.460266] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.460421] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.460528] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.460795] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.460933] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.462036] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.462036] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.462036] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.462036] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.462036] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.462036] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: bcb6f871-28e6-4f3e-b907-5d833f06bd12 is going to be created. [ 786.546893] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.547529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.547529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.547529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.547726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.558926] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.558926] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.558926] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.559215] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.559393] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.559658] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-bcb6f871-28e6-4f3e-b907-5d833f06bd12" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.563400] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52365fff-e017-4d11-ba53-f5893d863536 in Status: IN_PROGRESS for 2s [ 786.571472] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.670307] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-304 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.670587] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-304" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.670729] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-304" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.671142] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-304" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.672087] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.672392] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.672572] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.672942] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.673334] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.673481] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.673686] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.673915] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.674063] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.674222] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.674380] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.674529] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.721583] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.721791] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.047 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 786.721932] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.722127] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-304" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.722451] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-6dab447c-ed3d-4858-b8c4-715c67857a3b taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.722632] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-6dab447c-ed3d-4858-b8c4-715c67857a3b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.722745] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-6dab447c-ed3d-4858-b8c4-715c67857a3b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.723090] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-6dab447c-ed3d-4858-b8c4-715c67857a3b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.723230] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dab447c-ed3d-4858-b8c4-715c67857a3b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.779909] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.074052] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.074449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.074449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.074566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.074716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.074858] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 787.126405] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.126405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.126405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.126405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.126405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.135351] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 787.226937] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.227398] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.227612] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.228167] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.228354] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.228941] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 6dab447c-ed3d-4858-b8c4-715c67857a3b not found, creating... [ 787.229070] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.229478] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.229804] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.230270] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.230500] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.230913] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.231179] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.231352] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.231651] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.231817] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.231978] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 6dab447c-ed3d-4858-b8c4-715c67857a3b is going to be created. [ 787.260989] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.261234] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.261378] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.261771] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.262408] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.262512] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-6dab447c-ed3d-4858-b8c4-715c67857a3b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.283651] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.283839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.283977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.284162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.284741] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.284741] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be created. [ 787.321994] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.322177] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.322250] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.322564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.322735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.332354] env[65359]: INFO networking_nsxv3.common.synchronization [req-bf99695b-1fa3-4f2b-bbd0-5538c782ec9c req-580fd451-a297-4d08-b797-9b6bea1324cd service nova] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_rules [ 787.332591] env[65359]: INFO networking_nsxv3.common.synchronization [req-bf99695b-1fa3-4f2b-bbd0-5538c782ec9c req-580fd451-a297-4d08-b797-9b6bea1324cd service nova] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 787.332698] env[65359]: INFO networking_nsxv3.common.synchronization [req-bf99695b-1fa3-4f2b-bbd0-5538c782ec9c req-580fd451-a297-4d08-b797-9b6bea1324cd service nova] Enqueued Resource ID: bcb6f871-28e6-4f3e-b907-5d833f06bd12 with Priority: HIGHEST for action port [ 787.333410] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_rules [ 787.333607] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 787.333758] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb6f871-28e6-4f3e-b907-5d833f06bd12 with Priority: HIGHEST for action port [ 787.334215] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.334302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.334369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.334642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.334807] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.336345] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.336477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.337072] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcb6f871-28e6-4f3e-b907-5d833f06bd12 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.337072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcb6f871-28e6-4f3e-b907-5d833f06bd12" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.337072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcb6f871-28e6-4f3e-b907-5d833f06bd12" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.337072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcb6f871-28e6-4f3e-b907-5d833f06bd12" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.337434] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb6f871-28e6-4f3e-b907-5d833f06bd12',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.339455] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: UNINITIALIZED for 2s [ 787.839692] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.839692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.845024] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcb6f871-28e6-4f3e-b907-5d833f06bd12 with status ACTIVE [ 787.845024] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.845024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.845024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.845024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.845024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.845024] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.845024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.845024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.845024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.845024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.845024] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.845024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.845024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.845024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.845024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.845024] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcb6f871-28e6-4f3e-b907-5d833f06bd12 is going to be updated. [ 787.873141] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.873141] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.873141] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.873141] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.873141] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.873141] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcb6f871-28e6-4f3e-b907-5d833f06bd12" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.010648] env[65359]: INFO networking_nsxv3.common.synchronization [req-d80535c8-ff20-44ae-be2b-1445affc9e7a req-60e311c9-be1c-4ebb-87be-fc0a02772e4d service nova] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_rules [ 788.010854] env[65359]: INFO networking_nsxv3.common.synchronization [req-d80535c8-ff20-44ae-be2b-1445affc9e7a req-60e311c9-be1c-4ebb-87be-fc0a02772e4d service nova] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 788.010985] env[65359]: INFO networking_nsxv3.common.synchronization [req-d80535c8-ff20-44ae-be2b-1445affc9e7a req-60e311c9-be1c-4ebb-87be-fc0a02772e4d service nova] Enqueued Resource ID: 6dab447c-ed3d-4858-b8c4-715c67857a3b with Priority: HIGHEST for action port [ 788.011577] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_rules [ 788.011750] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 788.011815] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dab447c-ed3d-4858-b8c4-715c67857a3b with Priority: HIGHEST for action port [ 788.012377] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.012551] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.012697] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.012779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.012972] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dab447c-ed3d-4858-b8c4-715c67857a3b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.013109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dab447c-ed3d-4858-b8c4-715c67857a3b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.013165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dab447c-ed3d-4858-b8c4-715c67857a3b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.013374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dab447c-ed3d-4858-b8c4-715c67857a3b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.013523] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dab447c-ed3d-4858-b8c4-715c67857a3b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.516351] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6dab447c-ed3d-4858-b8c4-715c67857a3b with status ACTIVE [ 788.516678] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.516755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.516805] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.517157] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.517157] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.517315] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.517423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.517478] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.517697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.517827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.518194] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.518265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.518385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.518625] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.518757] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.519266] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6dab447c-ed3d-4858-b8c4-715c67857a3b is going to be updated. [ 788.543613] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.543759] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.543828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.544060] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.544197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.544606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dab447c-ed3d-4858-b8c4-715c67857a3b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.577977] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52365fff-e017-4d11-ba53-f5893d863536 in Status: SUCCESS [ 788.578275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.603457] env[65359]: INFO networking_nsxv3.common.synchronization [req-22bc5d4f-e262-42ba-b5a5-22bf1916fd33 req-d6bf0542-ca57-4703-8e5b-98e3578a34ca tempest-InstanceActionsV221TestJSON-732553247 tempest-InstanceActionsV221TestJSON-732553247-project-member] Enqueued Resource ID: 544e7b37-34ac-42c6-a973-4e3de7762947 with Priority: HIGHEST for action security_group_members [ 788.604073] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 544e7b37-34ac-42c6-a973-4e3de7762947 with Priority: HIGHEST for action security_group_members [ 788.604417] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-544e7b37-34ac-42c6-a973-4e3de7762947 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.604544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.604617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.604876] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.605038] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.605175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.605242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.605398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.605505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.605606] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('544e7b37-34ac-42c6-a973-4e3de7762947',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.830488] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-679 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.830689] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-679" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.830726] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-679" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.830995] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-679" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.833701] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.833701] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.833701] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.833701] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.833701] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.833701] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.833987] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.833987] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.833987] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.834136] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.834529] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.834529] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.863539] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.863847] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 788.863909] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.864114] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-679" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.864436] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-4fb18e05-1f79-4bb4-80ef-bce4204f50a0 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.864654] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-4fb18e05-1f79-4bb4-80ef-bce4204f50a0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.864772] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-4fb18e05-1f79-4bb4-80ef-bce4204f50a0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.865162] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-4fb18e05-1f79-4bb4-80ef-bce4204f50a0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.865304] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fb18e05-1f79-4bb4-80ef-bce4204f50a0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.108235] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.108431] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.108505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.108926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.110323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.110323] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.110323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.110323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.110323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.110637] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.110680] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 544e7b37-34ac-42c6-a973-4e3de7762947 is going to be updated. [ 789.144698] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.144861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.144934] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.145201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.145345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.163984] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 789.163984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.163984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.163984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.163984] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.163984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.163984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.163984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.163984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.163984] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.164873] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 544e7b37-34ac-42c6-a973-4e3de7762947 in Status: IN_PROGRESS for 2s [ 789.354149] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 789.354372] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.355271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.355563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.356059] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.356218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.356329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.356574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.356694] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.356792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.356924] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.358861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.359092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.359311] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.359448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.359511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.359738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.359831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.359934] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.369674] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.369899] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.370699] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.371352] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.371579] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.371764] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 4fb18e05-1f79-4bb4-80ef-bce4204f50a0 not found, creating... [ 789.372460] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.372623] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.372732] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.372903] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.373077] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.373397] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.373552] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.373684] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.373947] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.374145] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.374424] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 4fb18e05-1f79-4bb4-80ef-bce4204f50a0 is going to be created. [ 789.403131] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.403131] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.403131] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.403131] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.403131] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.403131] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-4fb18e05-1f79-4bb4-80ef-bce4204f50a0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.666482] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.862244] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.862397] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.862675] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.104038] env[65359]: INFO networking_nsxv3.common.synchronization [req-d80535c8-ff20-44ae-be2b-1445affc9e7a req-505476bc-2f13-46f4-a6a8-e56aebbde9ce service nova] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_rules [ 790.104234] env[65359]: INFO networking_nsxv3.common.synchronization [req-d80535c8-ff20-44ae-be2b-1445affc9e7a req-505476bc-2f13-46f4-a6a8-e56aebbde9ce service nova] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 790.104354] env[65359]: INFO networking_nsxv3.common.synchronization [req-d80535c8-ff20-44ae-be2b-1445affc9e7a req-505476bc-2f13-46f4-a6a8-e56aebbde9ce service nova] Enqueued Resource ID: 4fb18e05-1f79-4bb4-80ef-bce4204f50a0 with Priority: HIGHEST for action port [ 790.104920] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_rules [ 790.105409] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 790.105584] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb18e05-1f79-4bb4-80ef-bce4204f50a0 with Priority: HIGHEST for action port [ 790.106361] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.106463] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.106664] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.106774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.106986] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fb18e05-1f79-4bb4-80ef-bce4204f50a0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.107132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fb18e05-1f79-4bb4-80ef-bce4204f50a0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.107216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fb18e05-1f79-4bb4-80ef-bce4204f50a0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.107457] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fb18e05-1f79-4bb4-80ef-bce4204f50a0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.107637] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fb18e05-1f79-4bb4-80ef-bce4204f50a0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.168422] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.364939] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.609784] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4fb18e05-1f79-4bb4-80ef-bce4204f50a0 with status ACTIVE [ 790.610110] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.610297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.610374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.610597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.610711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.610896] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.610998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.611074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.611235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.611312] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.611555] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.611676] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.611745] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.611893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.611969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.612086] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4fb18e05-1f79-4bb4-80ef-bce4204f50a0 is going to be updated. [ 790.643782] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.643945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.644029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.644267] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.644457] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.644661] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fb18e05-1f79-4bb4-80ef-bce4204f50a0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.671709] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.672101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.672101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.672381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.672532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.673359] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 790.752945] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.753118] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.757811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.758251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.758950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.775722] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 790.873851] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.873851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.873851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.873851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.873851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.873851] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be updated. [ 790.932207] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.932207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.932207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.932597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.932597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.950979] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: IN_PROGRESS for 2s [ 791.178879] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 544e7b37-34ac-42c6-a973-4e3de7762947 in Status: SUCCESS [ 791.180255] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 544e7b37-34ac-42c6-a973-4e3de7762947 deletion is rescheduled due to dependency. [ 791.180255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-544e7b37-34ac-42c6-a973-4e3de7762947" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.792372] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 792.793054] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.793054] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.793309] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.793524] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.793666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.793737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.793932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.794034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.794176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.794667] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.961917] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 792.962231] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.962306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.962529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.962728] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.962844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.962907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.963085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.963160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.963243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.963403] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.963482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.963540] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.963776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.963842] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.963905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.963972] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.968409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.968482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.968597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.968699] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.970041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.970041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.970173] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.970231] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.970281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.971225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.971225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.971225] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.300210] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.300568] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.300568] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.300893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.301231] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.301231] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.301231] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.301810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.301810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.301810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.301810] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.301810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.301810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.302268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.302268] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.302268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.302268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.302488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.302488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.302645] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.302714] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.472829] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 153868d0-4b9a-4493-8289-08b4b26dc07b: rpc.has_security_group_logging(os_id): False [ 793.477574] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.495051] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.495293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.495382] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.495620] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.496186] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.496186] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.496186] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.496421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.496557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.496668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.496859] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.496968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.497040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.497178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.497366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.497444] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.497548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.497594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.497968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.498098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.498223] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be created. [ 793.569588] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.570850] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.570850] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.570850] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.570850] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.584101] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: IN_PROGRESS for 2s [ 793.805991] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5: rpc.has_security_group_logging(os_id): False [ 793.831977] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.832214] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.832362] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.832612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.832790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.833164] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.833339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.833415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.833631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.833752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.834022] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.834359] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.834465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.834669] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.834776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.835035] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.835155] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.835220] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.835421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.835525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.835927] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 793.910992] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.911214] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.911256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.911461] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.911700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.928763] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 793.979707] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.482412] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.482603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.482711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.483083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.483083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.483204] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be updated. [ 794.525668] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.525668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.525668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.525855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.526234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.536684] env[65359]: INFO networking_nsxv3.common.synchronization [req-c2a01fc1-fa57-4b59-b0e2-759f4396d6c3 req-e38322df-2f54-4d5d-8354-ab8895f65aaf tempest-ServerTagsTestJSON-1784386808 tempest-ServerTagsTestJSON-1784386808-project-member] Enqueued Resource ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 with Priority: HIGHEST for action security_group_members [ 794.537337] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: IN_PROGRESS for 2s [ 794.537976] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 with Priority: HIGHEST for action security_group_members [ 794.538148] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-0339c068-4c91-473c-9881-c7e3ea9393c0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.538281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.538353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.538602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.538761] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.538866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.538926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.539311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.539598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.539737] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0339c068-4c91-473c-9881-c7e3ea9393c0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.918247] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.918247] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-916" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.918247] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-916" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.918247] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-916" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.918247] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.919223] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.919521] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.919906] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.920858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.920858] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.921585] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.921585] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.921585] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.921752] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.921848] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.922063] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.943526] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.943836] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 794.944102] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.944377] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-916" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.944886] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-39ef5e29-3da7-45a1-adc6-623ef2d89ebc taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.945364] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-39ef5e29-3da7-45a1-adc6-623ef2d89ebc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.945675] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-39ef5e29-3da7-45a1-adc6-623ef2d89ebc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.946354] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-39ef5e29-3da7-45a1-adc6-623ef2d89ebc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.946645] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39ef5e29-3da7-45a1-adc6-623ef2d89ebc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.041767] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.041767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.041983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.042123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.042217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.042454] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.042602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.042648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.043171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.043249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.043870] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 already deleted. [ 795.043870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.449330] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.449559] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.449709] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.450010] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.450201] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.450772] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 39ef5e29-3da7-45a1-adc6-623ef2d89ebc not found, creating... [ 795.450772] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.450916] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.450951] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.451190] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.451324] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.451693] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.451865] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.451977] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.452203] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.452334] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.452519] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 39ef5e29-3da7-45a1-adc6-623ef2d89ebc is going to be created. [ 795.478432] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.478761] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.478966] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.479461] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.481376] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.481376] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-39ef5e29-3da7-45a1-adc6-623ef2d89ebc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.598140] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 795.598416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.598606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.598832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.598926] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.947967] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 795.948367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.101306] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.101306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.234742] env[65359]: INFO networking_nsxv3.common.synchronization [req-c2a01fc1-fa57-4b59-b0e2-759f4396d6c3 req-c10e3d35-efb0-491d-9598-0b3e69a41539 service nova] Enqueued Resource ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 with Priority: HIGHEST for action security_group_rules [ 796.234925] env[65359]: INFO networking_nsxv3.common.synchronization [req-c2a01fc1-fa57-4b59-b0e2-759f4396d6c3 req-c10e3d35-efb0-491d-9598-0b3e69a41539 service nova] Enqueued Resource ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 with Priority: HIGHEST for action security_group_members [ 796.235074] env[65359]: INFO networking_nsxv3.common.synchronization [req-c2a01fc1-fa57-4b59-b0e2-759f4396d6c3 req-c10e3d35-efb0-491d-9598-0b3e69a41539 service nova] Enqueued Resource ID: 39ef5e29-3da7-45a1-adc6-623ef2d89ebc with Priority: HIGHEST for action port [ 796.235622] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 with Priority: HIGHEST for action security_group_rules [ 796.235763] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 with Priority: HIGHEST for action security_group_members [ 796.235857] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39ef5e29-3da7-45a1-adc6-623ef2d89ebc with Priority: HIGHEST for action port [ 796.238088] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0339c068-4c91-473c-9881-c7e3ea9393c0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.238484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.239526] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.243042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.243125] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0339c068-4c91-473c-9881-c7e3ea9393c0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.244265] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-0339c068-4c91-473c-9881-c7e3ea9393c0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.248021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.248021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.248021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.248021] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.248021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.248021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.248021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.248021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.248021] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0339c068-4c91-473c-9881-c7e3ea9393c0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.248021] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-39ef5e29-3da7-45a1-adc6-623ef2d89ebc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.248021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39ef5e29-3da7-45a1-adc6-623ef2d89ebc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.248021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39ef5e29-3da7-45a1-adc6-623ef2d89ebc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.248021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39ef5e29-3da7-45a1-adc6-623ef2d89ebc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.248021] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39ef5e29-3da7-45a1-adc6-623ef2d89ebc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.548908] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 796.549132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.549333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.549571] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.549773] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.549887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.549982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.550235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.550384] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.550544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.550646] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.749251] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-0339c068-4c91-473c-9881-c7e3ea9393c0 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.749522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.749763] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0339c068-4c91-473c-9881-c7e3ea9393c0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.750791] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39ef5e29-3da7-45a1-adc6-623ef2d89ebc with status ACTIVE [ 796.751070] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.751225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.751225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.751478] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.753536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.753689] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.753754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.753848] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.754626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.754626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.754626] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.754626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.754807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.754837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.754911] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.754984] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39ef5e29-3da7-45a1-adc6-623ef2d89ebc is going to be updated. [ 796.781542] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.781737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.781812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.782244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.782329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.782445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39ef5e29-3da7-45a1-adc6-623ef2d89ebc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.054955] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.054955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.054955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.054955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.054955] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.054955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.054955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.054955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.054955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.055954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.055954] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.055954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.055954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.055954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.055954] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.055954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.055954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.055954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.055954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.057260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.057260] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.257713] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0339c068-4c91-473c-9881-c7e3ea9393c0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.558760] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 153868d0-4b9a-4493-8289-08b4b26dc07b: rpc.has_security_group_logging(os_id): False [ 797.578328] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.578694] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.578694] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.578883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.578943] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.579186] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.579293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.579349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.579553] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.579642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.579818] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.579918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.579978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.580132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.580206] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.580395] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.580489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.580551] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.580692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.580766] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.580984] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be updated. [ 797.646656] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.647459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.647459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.647459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.647459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.666856] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: IN_PROGRESS for 2s [ 797.760748] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.761024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.761156] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.761827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.761885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.762017] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 is going to be created. [ 797.807524] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.807743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.807837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.808119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.808330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.824074] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 in Status: UNINITIALIZED for 2s [ 799.684378] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 799.684816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.684875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.685180] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.685394] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.835857] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 in Status: SUCCESS [ 799.836104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.836269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.836492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.836686] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.836810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.836878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.837053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.837136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.837222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.837315] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0339c068-4c91-473c-9881-c7e3ea9393c0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.189179] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.189450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.189579] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.189866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.190111] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.190253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.190412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.190637] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.190752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.190878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.191013] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.339642] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-0339c068-4c91-473c-9881-c7e3ea9393c0 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.339870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.339870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.340143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.340320] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.340428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.340494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.340652] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.340775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.340817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.340994] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-0339c068-4c91-473c-9881-c7e3ea9393c0 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.341101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.341163] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.341314] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.341501] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.341685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.341802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.341875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.341953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.342050] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.342145] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0339c068-4c91-473c-9881-c7e3ea9393c0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.693614] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.694099] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.694099] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.694261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.694451] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.694588] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.694659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.694925] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.695026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.695158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.695374] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.695490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.695587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.695816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.696184] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.696184] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.696311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.696410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.696565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.696664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.696792] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.844277] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0339c068-4c91-473c-9881-c7e3ea9393c0: rpc.has_security_group_logging(os_id): False [ 800.865743] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.865873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.865960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.866356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.866520] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.866744] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.866836] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.866903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.867076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.867156] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.867353] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.867446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.867511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.867648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.867720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.867941] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.868119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.868190] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.869091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.869091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.869091] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 is going to be created. [ 800.954950] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.955505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.955505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.955505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.955631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.971842] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 in Status: IN_PROGRESS for 2s [ 801.134030] env[65359]: INFO networking_nsxv3.common.synchronization [None req-dce893cb-7090-4aa1-80e4-6ab806b61a44 tempest-ImagesOneServerNegativeTestJSON-1491004073 tempest-ImagesOneServerNegativeTestJSON-1491004073-project-member] Enqueued Resource ID: e23f8958-7c65-403f-ae67-4ed8ff7310d9 with Priority: HIGHEST for action security_group_rules [ 801.134030] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23f8958-7c65-403f-ae67-4ed8ff7310d9 with Priority: HIGHEST for action security_group_rules [ 801.134030] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23f8958-7c65-403f-ae67-4ed8ff7310d9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.134591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23f8958-7c65-403f-ae67-4ed8ff7310d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.134766] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23f8958-7c65-403f-ae67-4ed8ff7310d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.135114] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23f8958-7c65-403f-ae67-4ed8ff7310d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.135299] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23f8958-7c65-403f-ae67-4ed8ff7310d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.200116] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 153868d0-4b9a-4493-8289-08b4b26dc07b: rpc.has_security_group_logging(os_id): False [ 801.221189] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.221189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.221189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.221189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.221622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.221622] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.221622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.221835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.221870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.221929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.222324] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.222324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.222324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.222477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.222477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.222782] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.222782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.222782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.222900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.223017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.223062] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be updated. [ 801.270291] env[65359]: INFO networking_nsxv3.common.synchronization [None req-90251d80-c09d-48bb-a058-32095902f77d tempest-ImagesOneServerNegativeTestJSON-1491004073 tempest-ImagesOneServerNegativeTestJSON-1491004073-project-member] Enqueued Resource ID: e23f8958-7c65-403f-ae67-4ed8ff7310d9 with Priority: HIGHEST for action security_group_rules [ 801.270980] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23f8958-7c65-403f-ae67-4ed8ff7310d9 with Priority: HIGHEST for action security_group_rules [ 801.271359] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23f8958-7c65-403f-ae67-4ed8ff7310d9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.272095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23f8958-7c65-403f-ae67-4ed8ff7310d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.298500] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.298500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.298832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.298904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.299073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.316863] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: IN_PROGRESS for 2s [ 801.677157] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.677338] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.677411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.677587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.677907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.677907] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23f8958-7c65-403f-ae67-4ed8ff7310d9 already deleted. [ 801.677907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23f8958-7c65-403f-ae67-4ed8ff7310d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.678134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23f8958-7c65-403f-ae67-4ed8ff7310d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.678183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23f8958-7c65-403f-ae67-4ed8ff7310d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.678230] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23f8958-7c65-403f-ae67-4ed8ff7310d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.733376] env[65359]: INFO networking_nsxv3.common.synchronization [req-1bbaebd9-eba1-47d9-99b0-64ac35929c5c req-59501110-7028-4c2f-81cb-026cfc0f7091 tempest-DeleteServersTestJSON-2065668722 tempest-DeleteServersTestJSON-2065668722-project-member] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 801.733376] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 801.734048] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.734048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.734048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.734313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.734470] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.734575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.734648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.734845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.734915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.734966] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.185829] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-125 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.186150] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.186317] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.186589] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.186919] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.187072] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.187193] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.187479] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.187622] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.187832] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.187950] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.188062] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.188165] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.188323] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.188621] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.188719] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.209616] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.209616] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.209616] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.209870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.210009] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.211132] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23f8958-7c65-403f-ae67-4ed8ff7310d9 already deleted. [ 802.211132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23f8958-7c65-403f-ae67-4ed8ff7310d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.215791] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.216110] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 802.216361] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.216662] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.217271] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-4f799071-0f68-4c8f-82e6-1b5c3762ead2 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.217603] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-4f799071-0f68-4c8f-82e6-1b5c3762ead2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.217895] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-4f799071-0f68-4c8f-82e6-1b5c3762ead2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.218810] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-4f799071-0f68-4c8f-82e6-1b5c3762ead2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.218925] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f799071-0f68-4c8f-82e6-1b5c3762ead2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.238878] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.239309] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.239309] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.239631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.239631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.239776] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.239873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.239956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.240108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.240192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.240290] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 802.269824] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.270092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.270204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.270440] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.270592] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.283710] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 802.721807] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.722051] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.722179] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.722536] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.722719] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.722864] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 4f799071-0f68-4c8f-82e6-1b5c3762ead2 not found, creating... [ 802.723154] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.723390] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.723518] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.723748] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.723886] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.724199] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.724356] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.724652] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.724726] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.724858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.724995] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 4f799071-0f68-4c8f-82e6-1b5c3762ead2 is going to be created. [ 802.750868] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.751337] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.751337] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.751490] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.751754] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.752290] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-4f799071-0f68-4c8f-82e6-1b5c3762ead2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.993669] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 in Status: SUCCESS [ 802.993941] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.335071] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 803.335198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.603826] env[65359]: INFO networking_nsxv3.common.synchronization [req-1bbaebd9-eba1-47d9-99b0-64ac35929c5c req-a7a8ba53-ec51-49ff-a57d-ed1ca520a50b service nova] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_rules [ 803.604734] env[65359]: INFO networking_nsxv3.common.synchronization [req-1bbaebd9-eba1-47d9-99b0-64ac35929c5c req-a7a8ba53-ec51-49ff-a57d-ed1ca520a50b service nova] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 803.604993] env[65359]: INFO networking_nsxv3.common.synchronization [req-1bbaebd9-eba1-47d9-99b0-64ac35929c5c req-a7a8ba53-ec51-49ff-a57d-ed1ca520a50b service nova] Enqueued Resource ID: 4f799071-0f68-4c8f-82e6-1b5c3762ead2 with Priority: HIGHEST for action port [ 803.605583] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_rules [ 803.605732] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 803.605833] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f799071-0f68-4c8f-82e6-1b5c3762ead2 with Priority: HIGHEST for action port [ 803.606479] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.606884] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.606947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.607224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.607361] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.609032] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.609206] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.609512] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f799071-0f68-4c8f-82e6-1b5c3762ead2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.610115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f799071-0f68-4c8f-82e6-1b5c3762ead2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.610286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f799071-0f68-4c8f-82e6-1b5c3762ead2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.610703] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f799071-0f68-4c8f-82e6-1b5c3762ead2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.610868] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f799071-0f68-4c8f-82e6-1b5c3762ead2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.110249] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.110566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.113936] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f799071-0f68-4c8f-82e6-1b5c3762ead2 with status ACTIVE [ 804.114349] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.114612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.114691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.115044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.115187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.115483] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.115674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.115946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.116389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.116389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.116601] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.116755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.116863] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.117204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.117346] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.117513] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f799071-0f68-4c8f-82e6-1b5c3762ead2 is going to be updated. [ 804.145081] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.145271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.145383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.146675] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.146675] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.146675] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f799071-0f68-4c8f-82e6-1b5c3762ead2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.297159] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 804.297748] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb deletion is rescheduled due to dependency. [ 804.298062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.298527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.298879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.300023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.300023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.300023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.300023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.300023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.300419] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.806401] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.310232] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.813159] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.813460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.813605] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.813931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.814062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.814162] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 805.860460] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.861779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.861779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.861779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.862165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.881524] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 806.158252] env[65359]: INFO networking_nsxv3.common.synchronization [None req-d51fb5e4-0304-4609-9cb7-f0aa871dbcbe None None] Enqueued Resource ID: 47a75e23-30a2-4279-a81c-b0f63acb3eab with Priority: HIGHEST for action port [ 806.158856] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a75e23-30a2-4279-a81c-b0f63acb3eab with Priority: HIGHEST for action port [ 806.159197] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-47a75e23-30a2-4279-a81c-b0f63acb3eab taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.160015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47a75e23-30a2-4279-a81c-b0f63acb3eab" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.160270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47a75e23-30a2-4279-a81c-b0f63acb3eab" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.160381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47a75e23-30a2-4279-a81c-b0f63acb3eab" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.160778] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47a75e23-30a2-4279-a81c-b0f63acb3eab',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.231886] env[65359]: INFO networking_nsxv3.common.synchronization [req-210d176f-bcd9-48ed-bf08-1799fcee40c3 req-0fa3e79c-5ec5-4df3-916a-2309a47459e3 tempest-ServersTestJSON-1929866617 tempest-ServersTestJSON-1929866617-project-member] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 806.232910] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 806.233380] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.233542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.233865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.233936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.234127] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.234299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.234299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.234672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.234672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.234808] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.444129] env[65359]: INFO networking_nsxv3.common.synchronization [req-70efc3b5-2c57-4e5f-918b-742f43fa5b9e req-895b5c87-2504-427d-a74c-05b97c5db9ea tempest-ServersTestMultiNic-532988977 tempest-ServersTestMultiNic-532988977-project-member] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 806.445338] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 806.445338] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.445338] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.445479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.445671] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.445826] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.445904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.445904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.446077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.446194] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.446250] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.664020] env[65359]: INFO networking_nsxv3.common.synchronization [req-8f0a372b-3ab5-4507-89b5-e5c2521a287e req-e5296293-d302-40b5-a4b1-1de11dccb9c4 tempest-ImagesTestJSON-1497561183 tempest-ImagesTestJSON-1497561183-project-member] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 806.664020] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 806.664020] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.664020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.664020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.664315] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.665028] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.665028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.665028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.665028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.665258] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.665294] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.668053] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47a75e23-30a2-4279-a81c-b0f63acb3eab [ 806.668053] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.668053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.668053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.668053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.668053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.668053] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47a75e23-30a2-4279-a81c-b0f63acb3eab already deleted. [ 806.668374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47a75e23-30a2-4279-a81c-b0f63acb3eab" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.696830] env[65359]: INFO networking_nsxv3.common.synchronization [req-70efc3b5-2c57-4e5f-918b-742f43fa5b9e req-9f71ed5c-ca5f-48ec-b9d2-d20508514a86 tempest-ServersTestMultiNic-532988977 tempest-ServersTestMultiNic-532988977-project-member] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 806.697825] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 806.698409] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.699076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.736787] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.940023] env[65359]: INFO networking_nsxv3.common.synchronization [req-70efc3b5-2c57-4e5f-918b-742f43fa5b9e req-e6d2a036-a72f-44b4-851c-655bddb411f5 tempest-ServersTestMultiNic-532988977 tempest-ServersTestMultiNic-532988977-project-member] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 806.940023] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 806.940023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.940023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.948211] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.169231] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.170401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.170593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.171297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.171489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.173479] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.173479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.173479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.173479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.173479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.173479] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 807.203415] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.203415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.203415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.204195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.204195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.214561] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 807.239765] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.454125] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.744200] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.744405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.744448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.746297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.746297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.746297] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 807.788368] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.788525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.788676] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.789032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.789226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.805592] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 807.894050] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 807.894347] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.895026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.895344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.895622] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.895835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.895919] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.896111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.896188] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.896274] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.896365] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.957076] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.957076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.957076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.957393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.957484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.957531] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be updated. [ 807.998033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.998033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.998033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.998293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.998293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.013417] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: IN_PROGRESS for 2s [ 808.399705] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.399875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.399948] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.400222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.400405] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.400536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.400603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.400759] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.400840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.400925] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.401141] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.401307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.403020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.403020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.403020] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.403020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.403020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.403020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.403020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.403020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.403020] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.909354] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6b655ed-9de5-4842-96d3-3652c9e45ddb: rpc.has_security_group_logging(os_id): False [ 808.931029] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.931029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.931029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.931029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.931029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.931029] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.931029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.931029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.931029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.931029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.931029] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.931029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.931029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.931029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.931683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.931683] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.931683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.931683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.931683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.931683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.931941] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 808.996795] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.997174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.997174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.997437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.997608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.013458] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 809.047078] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8a41d34-610f-44b8-90b0-7fb4830bc928 req-d6f73429-658d-447e-bd58-341605e47812 tempest-ServersAdminNegativeTestJSON-660584843 tempest-ServersAdminNegativeTestJSON-660584843-project-member] Enqueued Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_members [ 809.048465] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 582cfc14-9eeb-4704-a95a-052a5b40435e with Priority: HIGHEST for action security_group_members [ 809.048465] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-582cfc14-9eeb-4704-a95a-052a5b40435e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.048634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.048634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.048759] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.049404] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.049790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.050430] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.050683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.050741] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.050830] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('582cfc14-9eeb-4704-a95a-052a5b40435e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.228055] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 809.228365] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 deletion is rescheduled due to dependency. [ 809.228606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.553624] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.553778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.553847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.554126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.554219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.554416] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.554513] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.554574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.554792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.554792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.554879] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 582cfc14-9eeb-4704-a95a-052a5b40435e is going to be updated. [ 809.583351] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.583508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.583561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.583769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.583908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.593325] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: IN_PROGRESS for 2s [ 809.819466] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 809.819697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.025698] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 810.026071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.026167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.026303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.026745] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.026745] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.026745] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.026988] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.026988] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.027419] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.529592] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.530009] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.530204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.530548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.530665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.530891] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.531049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.531084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.531321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.531451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.531619] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be updated. [ 810.570680] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.570915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.571131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.571426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.571611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.582652] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: IN_PROGRESS for 2s [ 811.030526] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 811.030909] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.605758] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 582cfc14-9eeb-4704-a95a-052a5b40435e in Status: SUCCESS [ 811.605953] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 582cfc14-9eeb-4704-a95a-052a5b40435e deletion is rescheduled due to dependency. [ 811.606090] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-582cfc14-9eeb-4704-a95a-052a5b40435e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.593350] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 812.593610] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b deletion is rescheduled due to dependency. [ 812.593610] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.593770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.593982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.594185] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.594302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.594368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.594514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.594593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.594689] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.096673] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.097044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.097186] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.097499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.097668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.098050] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.098145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.098202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.098394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.098503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.098623] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be updated. [ 813.125531] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.125693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.125738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.125957] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.126112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.136010] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: IN_PROGRESS for 2s [ 813.738473] env[65359]: INFO networking_nsxv3.common.synchronization [req-e3cd5286-c3c4-41c5-9df6-737cf73230c0 req-fb9f1b3d-ee36-434a-8b8c-1adb5e56acb9 tempest-ServerTagsTestJSON-1784386808 tempest-ServerTagsTestJSON-1784386808-project-member] Enqueued Resource ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 with Priority: HIGHEST for action security_group_members [ 813.739042] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 with Priority: HIGHEST for action security_group_members [ 813.739362] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-0339c068-4c91-473c-9881-c7e3ea9393c0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.739477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.739657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.739850] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.740024] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.740170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.740261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.740428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.740518] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.740613] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0339c068-4c91-473c-9881-c7e3ea9393c0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.243264] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.243507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.243507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.243728] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.243846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.244111] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.244225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.244291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.244464] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.244543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.244632] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 is going to be updated. [ 814.285515] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.285777] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.285777] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.285982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.286141] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.295817] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 in Status: IN_PROGRESS for 2s [ 814.952257] env[65359]: INFO networking_nsxv3.common.synchronization [req-7a97d7a8-85b2-4cbc-b933-2f3bac07e96d req-81425dab-d5db-47c4-b30a-cf2bde5751d7 tempest-ListImageFiltersTestJSON-1057169836 tempest-ListImageFiltersTestJSON-1057169836-project-member] Enqueued Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_members [ 814.952805] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_members [ 814.953758] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.953758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.953758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.953758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.953758] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.953758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.954235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.954235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.955323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.955459] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.146686] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 815.147016] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b deletion is rescheduled due to dependency. [ 815.147203] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.459196] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.961017] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.307685] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 in Status: SUCCESS [ 816.307866] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 deletion is rescheduled due to dependency. [ 816.307988] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.465985] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.466243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.466358] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.466646] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.466824] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.466963] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655ee501-2055-483e-a130-4cf497421bd3 is going to be updated. [ 816.496578] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.496731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.496806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.497040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.497201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.506860] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: IN_PROGRESS for 2s [ 817.802465] env[65359]: INFO networking_nsxv3.common.synchronization [req-4a6567af-dd28-4670-ab78-0c6e43bad08f req-15c08de1-7fae-4ff9-afe9-70969e996547 tempest-ServersAdminTestJSON-387763736 tempest-ServersAdminTestJSON-387763736-project-member] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 817.802937] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 817.803277] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.803541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.803619] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.803820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.803977] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.804093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.804155] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.804302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.804388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.804545] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.307138] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.520352] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: SUCCESS [ 818.520602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.810060] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.312468] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.312468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.312588] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.312720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.312873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.312986] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be updated. [ 819.343254] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.343743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.343743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.343743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.343905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.353984] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 821.365581] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 821.365972] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.467869] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.467869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.467869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.467869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.467869] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.804227] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 822.804227] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 822.970243] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.297132] env[65359]: INFO networking_nsxv3.common.synchronization [None req-ae760967-6b7f-45e0-b4ad-1a8dddd91a9c None None] Enqueued Resource ID: b49a19c0-bdd2-466f-bae4-1da9daea4de4 with Priority: HIGHEST for action port [ 823.297676] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49a19c0-bdd2-466f-bae4-1da9daea4de4 with Priority: HIGHEST for action port [ 823.297988] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-b49a19c0-bdd2-466f-bae4-1da9daea4de4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.298176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b49a19c0-bdd2-466f-bae4-1da9daea4de4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.298303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b49a19c0-bdd2-466f-bae4-1da9daea4de4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.298303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b49a19c0-bdd2-466f-bae4-1da9daea4de4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.299463] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b49a19c0-bdd2-466f-bae4-1da9daea4de4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.473647] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.804160] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b49a19c0-bdd2-466f-bae4-1da9daea4de4 [ 823.804400] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.804540] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.804605] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.804824] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.804920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.805040] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b49a19c0-bdd2-466f-bae4-1da9daea4de4 already deleted. [ 823.805147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b49a19c0-bdd2-466f-bae4-1da9daea4de4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.976569] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 823.976700] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 823.992332] env[65359]: INFO networking_nsxv3.common.synchronization [req-2c2e8eb1-5609-472d-b480-f3eb73841e88 req-d5dc943f-ad40-4fed-a737-593217a43c6a tempest-ServerMetadataNegativeTestJSON-1627460128 tempest-ServerMetadataNegativeTestJSON-1627460128-project-member] Enqueued Resource ID: 1b7c1c93-5692-4546-9b54-4011872a824d with Priority: HIGHEST for action security_group_members [ 823.992885] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7c1c93-5692-4546-9b54-4011872a824d with Priority: HIGHEST for action security_group_members [ 823.993222] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7c1c93-5692-4546-9b54-4011872a824d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.993333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.993384] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.993654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.993831] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.993911] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.993959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.994672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.994771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.995220] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7c1c93-5692-4546-9b54-4011872a824d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.432205] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-216 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.432414] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-216" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.432757] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-216" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.432876] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-216" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.434053] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.434053] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.434053] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.434053] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.434053] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.434053] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 824.434053] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 824.434499] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 824.434499] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 824.434499] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 824.434690] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 824.434730] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 824.466051] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 824.466225] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 824.466357] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 824.466549] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-216" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.467055] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-186c2a80-9fce-4f55-b746-e16ff43de73c taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.467279] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-186c2a80-9fce-4f55-b746-e16ff43de73c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.467279] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-186c2a80-9fce-4f55-b746-e16ff43de73c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.467555] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-186c2a80-9fce-4f55-b746-e16ff43de73c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.467690] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('186c2a80-9fce-4f55-b746-e16ff43de73c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.498039] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.498401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.498401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.498540] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.498649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.498767] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.498947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.498947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.499399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.499399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.499547] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7c1c93-5692-4546-9b54-4011872a824d already deleted. [ 824.499547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.860530] env[65359]: INFO networking_nsxv3.common.synchronization [req-c4c8e11e-5825-46a3-8b7d-3f1bcab6895b req-74e12ba2-1755-4c31-bfd3-b85bf44948d5 tempest-VolumesAssistedSnapshotsTest-1704132221 tempest-VolumesAssistedSnapshotsTest-1704132221-project-member] Enqueued Resource ID: 505f1bca-748c-4f56-9f01-2a595d335a84 with Priority: HIGHEST for action security_group_members [ 824.861091] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505f1bca-748c-4f56-9f01-2a595d335a84 with Priority: HIGHEST for action security_group_members [ 824.861405] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-505f1bca-748c-4f56-9f01-2a595d335a84 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.861530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.861602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.861823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.862067] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.862067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.862229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.862281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.862341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.862433] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('505f1bca-748c-4f56-9f01-2a595d335a84',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.974335] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.974335] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.974335] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.974335] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.974335] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.974335] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 186c2a80-9fce-4f55-b746-e16ff43de73c not found, creating... [ 824.974335] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.974335] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.974335] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.974335] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.974335] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.974800] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.974800] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.974800] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.974800] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.974800] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.974800] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 186c2a80-9fce-4f55-b746-e16ff43de73c is going to be created. [ 824.997883] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.998108] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.998288] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.998598] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.998854] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.999125] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-186c2a80-9fce-4f55-b746-e16ff43de73c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.023659] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.023825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.023905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.024158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.040069] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 825.043403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.043403] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 825.135857] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.136237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.136357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.138204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.151862] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.152862] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 825.152992] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 825.153161] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 825.198947] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.199200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.199200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.199483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.200980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.204964] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 825.293923] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.294248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.294248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.294430] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.294596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.295921] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 825.364899] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.365112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.365200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.365427] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.368875] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.369017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.369070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.369259] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.369536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.369760] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:34. [ 825.369855] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'09044820-85da-426b-b103-26678a0652e6', 'a6cbdd6f-4665-46af-8251-3803d47cff8b', 'f33a6cb0-88e0-45c4-8990-6da48fb9f1f5', '7a31eada-fa66-45f2-8fea-2e11279344df', '703826e2-1d66-436e-9721-f997727e26c4', 'b74f2d49-4463-4031-b68b-ccef6e58b773', '5e01edf8-56d4-4ad5-91cc-fcc882a409c8', 'c4dca704-f8c2-494f-bbf6-802020c49b4b', 'db2b8872-8032-4084-b9ac-eddda23d1176', '46b0db53-8bd6-4cc8-90b3-dd8299fa29cd', '6eb7ac19-945a-427f-84cb-cc4a488527fc', '7565297c-f219-4968-8aee-c13251599a0c', '55c3d269-f804-4fd7-b878-8a037bb5df82', '0339c068-4c91-473c-9881-c7e3ea9393c0', 'd3577cfc-adec-4c56-bc24-6acdb8887663', '78b29888-5f88-401c-8a70-59d4c410c80d', '655ee501-2055-483e-a130-4cf497421bd3', '153868d0-4b9a-4493-8289-08b4b26dc07b', 'd6b655ed-9de5-4842-96d3-3652c9e45ddb', '1cada3c1-366e-43a5-923b-57e235de0cb4', '505f1bca-748c-4f56-9f01-2a595d335a84', '28737c44-388f-4cb8-9cac-0181cbb28981', 'f713e30a-d102-48fb-9e09-3c3ec7abbc99', '8c01e6ff-b831-4d21-8c9a-e3a067190d76', 'b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685', 'b1f01646-6e50-4a59-a98b-3f8bba190b64', '1d7b1c61-3e92-4ac1-82a4-572363e1e5a5', '316dc9d7-17d3-414d-ba0c-8e1fd143cf19', 'c053aa73-c45e-4ff7-9c78-5faef3e76294', '8f94b344-4b21-4fd0-9c3a-2488e3e7e504', '582cfc14-9eeb-4704-a95a-052a5b40435e', '544e7b37-34ac-42c6-a973-4e3de7762947', '43a4df49-7816-4678-be36-250c471235e3', '52365fff-e017-4d11-ba53-f5893d863536'} {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 825.369951] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 825.394913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.395210] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.395337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.395405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.395607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.395689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.395791] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 505f1bca-748c-4f56-9f01-2a595d335a84 is going to be updated. [ 825.399185] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.399302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.399493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.399548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.399627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.399754] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 825.399830] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 825.399901] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 825.433386] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.433386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.433386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.433386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.433386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.442187] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 505f1bca-748c-4f56-9f01-2a595d335a84 in Status: IN_PROGRESS for 2s [ 825.464503] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.466205] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.466205] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.466205] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.467073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.470250] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 825.470250] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 825.470250] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 825.470250] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 825.470250] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/34 resources of Type:Security Group Rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a31eada-fa66-45f2-8fea-2e11279344df with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b74f2d49-4463-4031-b68b-ccef6e58b773 with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: db2b8872-8032-4084-b9ac-eddda23d1176 with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7565297c-f219-4968-8aee-c13251599a0c with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78b29888-5f88-401c-8a70-59d4c410c80d with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 with Priority: HIGH for action security_group_rules [ 825.470250] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.755158] env[65359]: INFO networking_nsxv3.common.synchronization [req-2c2e8eb1-5609-472d-b480-f3eb73841e88 req-60fceaa1-fee8-4eb7-8c0d-6735f8cae66c service nova] Enqueued Resource ID: 1b7c1c93-5692-4546-9b54-4011872a824d with Priority: HIGHEST for action security_group_rules [ 825.755158] env[65359]: INFO networking_nsxv3.common.synchronization [req-2c2e8eb1-5609-472d-b480-f3eb73841e88 req-60fceaa1-fee8-4eb7-8c0d-6735f8cae66c service nova] Enqueued Resource ID: 1b7c1c93-5692-4546-9b54-4011872a824d with Priority: HIGHEST for action security_group_members [ 825.755158] env[65359]: INFO networking_nsxv3.common.synchronization [req-2c2e8eb1-5609-472d-b480-f3eb73841e88 req-60fceaa1-fee8-4eb7-8c0d-6735f8cae66c service nova] Enqueued Resource ID: 186c2a80-9fce-4f55-b746-e16ff43de73c with Priority: HIGHEST for action port [ 825.755158] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7c1c93-5692-4546-9b54-4011872a824d with Priority: HIGHEST for action security_group_rules [ 825.755158] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7c1c93-5692-4546-9b54-4011872a824d with Priority: HIGHEST for action security_group_members [ 825.755158] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186c2a80-9fce-4f55-b746-e16ff43de73c with Priority: HIGHEST for action port [ 825.755158] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGH for action security_group_rules [ 825.755614] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGH for action security_group_rules [ 825.755614] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 with Priority: HIGH for action security_group_rules [ 825.755761] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGH for action security_group_rules [ 825.755894] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 with Priority: HIGH for action security_group_rules [ 825.756610] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGH for action security_group_rules [ 825.756789] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGH for action security_group_rules [ 825.757437] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGH for action security_group_rules [ 825.757437] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 with Priority: HIGH for action security_group_rules [ 825.757437] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b29888-5f88-401c-8a70-59d4c410c80d with Priority: HIGH for action security_group_rules [ 825.757437] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 with Priority: HIGH for action security_group_rules [ 825.757437] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7565297c-f219-4968-8aee-c13251599a0c with Priority: HIGH for action security_group_rules [ 825.757437] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGH for action security_group_rules [ 825.757817] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd with Priority: HIGH for action security_group_rules [ 825.757979] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2b8872-8032-4084-b9ac-eddda23d1176 with Priority: HIGH for action security_group_rules [ 825.758116] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b74f2d49-4463-4031-b68b-ccef6e58b773 with Priority: HIGH for action security_group_rules [ 825.761026] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGH for action security_group_rules [ 825.761026] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703826e2-1d66-436e-9721-f997727e26c4 with Priority: HIGH for action security_group_rules [ 825.761026] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6cbdd6f-4665-46af-8251-3803d47cff8b with Priority: HIGH for action security_group_rules [ 825.761026] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a31eada-fa66-45f2-8fea-2e11279344df with Priority: HIGH for action security_group_rules [ 825.761026] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b7c1c93-5692-4546-9b54-4011872a824d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.761026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.761026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.761026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.761026] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b7c1c93-5692-4546-9b54-4011872a824d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.761026] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7c1c93-5692-4546-9b54-4011872a824d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.761953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.761953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.762072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.762260] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.762402] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.762488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.762672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.762784] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.762896] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7c1c93-5692-4546-9b54-4011872a824d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.763809] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-186c2a80-9fce-4f55-b746-e16ff43de73c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.763949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-186c2a80-9fce-4f55-b746-e16ff43de73c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.764071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-186c2a80-9fce-4f55-b746-e16ff43de73c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.764260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-186c2a80-9fce-4f55-b746-e16ff43de73c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.764372] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('186c2a80-9fce-4f55-b746-e16ff43de73c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.767288] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.767451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.768044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.769434] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.769434] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.770993] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.771158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.772081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.772347] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.772467] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.773996] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e01edf8-56d4-4ad5-91cc-fcc882a409c8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.773996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.773996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.774505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.774741] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e01edf8-56d4-4ad5-91cc-fcc882a409c8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.776805] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.776993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.777311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.777385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.777506] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.778873] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cada3c1-366e-43a5-923b-57e235de0cb4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.779679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.779813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.780049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.780166] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cada3c1-366e-43a5-923b-57e235de0cb4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.782677] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.783573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.783695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.783923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.784294] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.785469] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.786367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.786884] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.786884] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.786884] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.788178] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.789108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.789108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.789108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.789268] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.789558] env[65359]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 825.790773] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0339c068-4c91-473c-9881-c7e3ea9393c0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.790773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.790773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.791617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.791836] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0339c068-4c91-473c-9881-c7e3ea9393c0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.793300] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b29888-5f88-401c-8a70-59d4c410c80d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.793831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.794539] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.794539] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.794539] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b29888-5f88-401c-8a70-59d4c410c80d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.796216] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55c3d269-f804-4fd7-b878-8a037bb5df82 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.796377] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.796474] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.796688] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.796786] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55c3d269-f804-4fd7-b878-8a037bb5df82',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.798339] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7565297c-f219-4968-8aee-c13251599a0c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.798533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.798633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.798830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.798940] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7565297c-f219-4968-8aee-c13251599a0c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.799927] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.800388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.800576] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.800731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.800834] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.801870] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.802359] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.802474] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.802665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.802776] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46b0db53-8bd6-4cc8-90b3-dd8299fa29cd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.803915] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db2b8872-8032-4084-b9ac-eddda23d1176 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.804371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.804480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.804669] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.804778] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db2b8872-8032-4084-b9ac-eddda23d1176',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.805667] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b74f2d49-4463-4031-b68b-ccef6e58b773 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.806100] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.806213] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.806398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.806508] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b74f2d49-4463-4031-b68b-ccef6e58b773',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.807703] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.807703] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.807703] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.807703] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.807905] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.809074] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-703826e2-1d66-436e-9721-f997727e26c4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.809565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.809695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.809854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.809969] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('703826e2-1d66-436e-9721-f997727e26c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.810209] env[65359]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 825.810935] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6cbdd6f-4665-46af-8251-3803d47cff8b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.811348] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.811628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.811862] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.812333] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6cbdd6f-4665-46af-8251-3803d47cff8b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.813867] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a31eada-fa66-45f2-8fea-2e11279344df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.813867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.813867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.814116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.814194] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a31eada-fa66-45f2-8fea-2e11279344df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.820746] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b7c1c93-5692-4546-9b54-4011872a824d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.823623] env[65359]: INFO networking_nsxv3.common.synchronization [None req-8c50964b-3bb1-454b-bcf7-e6ade9964992 None None] Enqueued Resource ID: 4e1579d9-4195-4e8b-94aa-64ed4f2f6e90 with Priority: HIGHEST for action port [ 825.828209] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1579d9-4195-4e8b-94aa-64ed4f2f6e90 with Priority: HIGHEST for action port [ 825.831126] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e1579d9-4195-4e8b-94aa-64ed4f2f6e90 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.831209] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e1579d9-4195-4e8b-94aa-64ed4f2f6e90" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.831252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e1579d9-4195-4e8b-94aa-64ed4f2f6e90" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.831908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e1579d9-4195-4e8b-94aa-64ed4f2f6e90" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.831908] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e1579d9-4195-4e8b-94aa-64ed4f2f6e90',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.986676] env[65359]: INFO networking_nsxv3.common.synchronization [req-3ff48c77-618d-4bd5-8912-321ae9e34f55 req-1aa835cf-0c7e-4a5c-8dba-78300fbad2fd tempest-ServersTestJSON-1097476844 tempest-ServersTestJSON-1097476844-project-member] Enqueued Resource ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 with Priority: HIGHEST for action security_group_members [ 825.989722] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 with Priority: HIGHEST for action security_group_members [ 825.992084] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.992368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.992368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.992502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.992660] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.992750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.992808] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.992970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.993119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.993218] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.263131] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7c1c93-5692-4546-9b54-4011872a824d taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.263131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.271631] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.271860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.271936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.272898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.272898] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.272898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.272898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.272898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.272898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.272898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.273152] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.319600] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 186c2a80-9fce-4f55-b746-e16ff43de73c with status ACTIVE [ 826.320926] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.320926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.320926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.320926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.320926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.320926] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.320926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.321278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.321351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.321470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.321674] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.321871] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.321957] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.322102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.322190] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.323591] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 186c2a80-9fce-4f55-b746-e16ff43de73c is going to be updated. [ 826.327455] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b7c1c93-5692-4546-9b54-4011872a824d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.343593] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.343803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.343803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.344011] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.347435] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.347597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.347645] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.347807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.347941] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.348109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-186c2a80-9fce-4f55-b746-e16ff43de73c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.364888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.364888] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 is going to be deleted. [ 826.453360] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.453542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.453680] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.453947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.454415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.454415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.491635] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e1579d9-4195-4e8b-94aa-64ed4f2f6e90 [ 826.491635] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.491635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.491635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.491635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.491635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.491635] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e1579d9-4195-4e8b-94aa-64ed4f2f6e90 already deleted. [ 826.491635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e1579d9-4195-4e8b-94aa-64ed4f2f6e90" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.498378] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.498378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.498378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.498378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.509045] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.509045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.509045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.509045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.509251] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.509251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.509339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.510489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.510489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.510489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.510489] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.516286] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.519055] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.519055] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.519055] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.519055] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.519055] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.519055] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.519055] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.519055] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.519055] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.519055] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.531453] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.531684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.531895] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.532095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.532324] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.532495] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.532599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.532832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.533330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.533508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.533646] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.539498] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.539824] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.539902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.540370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.540496] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.540760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.540829] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.540999] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.541094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.541180] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.541338] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.549406] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.549406] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.549516] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.550336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.550336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.550336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.550336] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 is going to be updated. [ 826.572070] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.572290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.572402] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.572763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.594594] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.594594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.614815] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.614943] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.616068] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.616186] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.619321] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.619415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.620280] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.620381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.621182] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.621280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.622160] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.622259] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.623090] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.623224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.624719] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.624910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.629793] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.629903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.632823] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 826.633493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.633617] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7565297c-f219-4968-8aee-c13251599a0c is going to be deleted. [ 826.639296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.639296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.639296] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.639296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.649314] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.649467] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.650212] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 826.650661] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.650797] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.652083] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 826.652561] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.652706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.652796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.653096] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.654170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.661046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.661206] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55c3d269-f804-4fd7-b878-8a037bb5df82 is going to be deleted. [ 826.662217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.662432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.663837] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 in Status: IN_PROGRESS for 2s [ 826.685831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.687034] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e01edf8-56d4-4ad5-91cc-fcc882a409c8 is going to be deleted. [ 826.687034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.687165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.716185] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.716185] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a31eada-fa66-45f2-8fea-2e11279344df is going to be deleted. [ 826.716487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.716710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.752730] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.752947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.756511] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.756810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.760395] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.760395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.770781] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 826.771324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.771451] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b29888-5f88-401c-8a70-59d4c410c80d is going to be deleted. [ 826.772528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.774727] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.775670] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.775753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.775791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.776169] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.776169] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.776321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.776415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.776587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.776688] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.776758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.776909] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.777026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.777111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.777424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.777424] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.777529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.777564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.777671] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.777748] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.777831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.777934] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.816572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.816572] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db2b8872-8032-4084-b9ac-eddda23d1176 is going to be deleted. [ 826.816572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.816572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.829195] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.829350] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.829422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.829640] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.829878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.829878] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7c1c93-5692-4546-9b54-4011872a824d is going to be created. [ 826.890901] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.891099] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.891148] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.891527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.891750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.896257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.896447] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 703826e2-1d66-436e-9721-f997727e26c4 is going to be deleted. [ 826.897470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.897680] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.903904] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.904041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.923324] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7c1c93-5692-4546-9b54-4011872a824d in Status: UNINITIALIZED for 2s [ 826.999799] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.000061] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b74f2d49-4463-4031-b68b-ccef6e58b773 is going to be deleted. [ 827.001017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.001191] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.022188] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.022400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.023140] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.023253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.028037] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.029057] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.029508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.029508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.029508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.029508] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.029709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.029709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.029888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.030269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.030269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.030269] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.030828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.030828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.030828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.030828] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.030828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.030828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.031074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.031074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.031074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.031987] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.039808] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.039950] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46b0db53-8bd6-4cc8-90b3-dd8299fa29cd is going to be deleted. [ 827.040829] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.041066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.046476] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.046650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.046693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.046859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.047035] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.047140] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.047215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.047335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.047417] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.047501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.047644] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.047733] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.048066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.048066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.048066] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.048236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.048236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.048354] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.048426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.048517] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.048603] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.055266] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.055403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.055459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.055644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.055794] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.055963] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.056045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.056217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.056287] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.056371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.056517] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.056610] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.056670] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.056809] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.056945] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.057046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.057107] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.057242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.057316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.057397] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.057484] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.104210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.104210] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0339c068-4c91-473c-9881-c7e3ea9393c0 is going to be deleted. [ 827.104210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.104210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.160940] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.161215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.167425] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.167598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.175679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.177977] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be deleted. [ 827.177977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.178359] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.272498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.272702] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6cbdd6f-4665-46af-8251-3803d47cff8b is going to be deleted. [ 827.274300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.274647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.280797] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 09044820-85da-426b-b103-26678a0652e6: rpc.has_security_group_logging(os_id): False [ 827.308942] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.308942] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.315340] env[65359]: INFO networking_nsxv3.common.synchronization [req-a9841616-fea6-47ff-b00e-03ad0e60237c req-b2a66b3a-85d2-4f8d-af43-26d101d37681 tempest-DeleteServersTestJSON-2065668722 tempest-DeleteServersTestJSON-2065668722-project-member] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 827.315340] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 827.315340] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.315340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.315340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.315340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.315340] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.315340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.315340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.315340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.315340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.315340] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.329486] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.329486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.344870] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.345922] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.377784] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.377784] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cada3c1-366e-43a5-923b-57e235de0cb4 is going to be deleted. [ 827.377784] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.377784] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.394331] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.395384] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.435052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.435052] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be deleted. [ 827.435052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.435052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.435052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.435052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7565297c-f219-4968-8aee-c13251599a0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.435052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.435052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.435052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.435052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55c3d269-f804-4fd7-b878-8a037bb5df82" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.436324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.436692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.436901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.437146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e01edf8-56d4-4ad5-91cc-fcc882a409c8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.437508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.437784] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.437974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.438213] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a31eada-fa66-45f2-8fea-2e11279344df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.438468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.438716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.438892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.439132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db2b8872-8032-4084-b9ac-eddda23d1176" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.440611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.440611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.440611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.440611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b29888-5f88-401c-8a70-59d4c410c80d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.440611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.440611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.440611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.440611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b74f2d49-4463-4031-b68b-ccef6e58b773" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.440611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.441149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.441339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.441567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-703826e2-1d66-436e-9721-f997727e26c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.441869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.442154] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.442363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.442612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46b0db53-8bd6-4cc8-90b3-dd8299fa29cd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.444254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.444550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.465220] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 505f1bca-748c-4f56-9f01-2a595d335a84 in Status: SUCCESS [ 827.465220] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 505f1bca-748c-4f56-9f01-2a595d335a84 deletion is rescheduled due to dependency. [ 827.465220] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.480800] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.480929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.499994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.500362] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.500502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.500502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.500730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.500808] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.501258] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.501258] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.501258] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.501569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.501569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.501569] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.501842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.501842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.501955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.501955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.502088] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09044820-85da-426b-b103-26678a0652e6 is going to be updated. [ 827.503310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.503382] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.503438] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.504285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0339c068-4c91-473c-9881-c7e3ea9393c0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.504285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.504285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.504285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.504285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.504285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.504285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.504567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.504567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6cbdd6f-4665-46af-8251-3803d47cff8b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.533367] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3577cfc-adec-4c56-bc24-6acdb8887663: rpc.has_security_group_logging(os_id): False [ 827.534515] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6eb7ac19-945a-427f-84cb-cc4a488527fc: rpc.has_security_group_logging(os_id): False [ 827.550446] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6b655ed-9de5-4842-96d3-3652c9e45ddb: rpc.has_security_group_logging(os_id): False [ 827.561615] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 655ee501-2055-483e-a130-4cf497421bd3: rpc.has_security_group_logging(os_id): False [ 827.598820] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.599011] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.599095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.599338] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.601246] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.601392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.603384] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.603537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.611906] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.612066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.630883] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.631302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.650790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.651105] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.651227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.651292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.651503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.651584] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.651832] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.651950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.652051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.652181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.652246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.652426] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.652515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.652578] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.652693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.652896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.653260] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be updated. [ 827.654443] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.654661] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.656236] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.656360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.724103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.724103] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.724103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.724103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.724103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.724103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.724103] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 is going to be updated. [ 827.724103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.724103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.724103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.725437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cada3c1-366e-43a5-923b-57e235de0cb4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.725675] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.725930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.820903] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.820903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.905680] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.905989] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.906130] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.906201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.906408] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.906492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.906696] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.906797] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.906861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.907208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.907342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.907631] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.907766] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.907869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.908316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.908499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.910602] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 655ee501-2055-483e-a130-4cf497421bd3 is going to be updated. [ 827.910602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.910837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.910923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.911144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.911342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.911785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.914261] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.914261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.970854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.971167] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.971292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.971363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.971576] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.971663] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.971927] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.972084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.972187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.972414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.972502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.972705] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.972780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.972840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.973015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.973096] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.973197] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 827.974312] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.974478] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.974622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.975582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.975736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.975822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.976014] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.976122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.976187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.976327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.976404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.976482] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 828.006821] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.006821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.007080] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.007285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.007555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.054656] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.054656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.054656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.054656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.054656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.056594] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.056802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.056802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.057305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.057305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.060063] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: IN_PROGRESS for 2s [ 828.063962] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 828.105676] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.105879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.105925] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.106151] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.106313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.108196] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: IN_PROGRESS for 2s [ 828.126031] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: IN_PROGRESS for 2s [ 828.136441] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 828.208835] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 828.209478] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.210345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.210345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.210345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.210345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.232126] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 828.674035] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 in Status: SUCCESS [ 828.674035] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685 deletion is rescheduled due to dependency. [ 828.674035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.938235] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7c1c93-5692-4546-9b54-4011872a824d in Status: SUCCESS [ 828.938235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.938235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.938235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.938235] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.938235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.938235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.938235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.938235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.938235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.938235] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b7c1c93-5692-4546-9b54-4011872a824d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.975894] env[65359]: INFO networking_nsxv3.common.synchronization [req-434ac87d-09c9-480e-833e-54f8a51a2741 req-b44e27c0-946d-41f5-b6dd-3fed496f556e tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 828.975894] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 828.976098] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.976098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.976222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.976381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.976526] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.976920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.976920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.976920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.976920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.977367] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.980493] env[65359]: INFO networking_nsxv3.common.synchronization [req-e1150eb5-12fa-4cc4-99c9-b699f7b7ae71 req-4e13988f-9cb5-4331-bb8a-b8fd5d4a0599 tempest-ServerDiskConfigTestJSON-2085995032 tempest-ServerDiskConfigTestJSON-2085995032-project-member] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 828.980858] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 828.981339] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.981460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.981522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.981685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.981869] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.981968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.982043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.982289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.982289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.982384] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.363382] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.364063] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.364063] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.364063] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.364602] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.364803] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.364881] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.365295] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.365438] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.365646] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.365756] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.365858] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.365961] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.366079] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.366182] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.366313] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.385188] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.385363] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.385500] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.385678] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.386026] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-ce4c61da-cfaf-4d8a-94e5-f63fb7f13310 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.386164] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-ce4c61da-cfaf-4d8a-94e5-f63fb7f13310" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.386688] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-ce4c61da-cfaf-4d8a-94e5-f63fb7f13310" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.386950] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-ce4c61da-cfaf-4d8a-94e5-f63fb7f13310" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.387137] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce4c61da-cfaf-4d8a-94e5-f63fb7f13310',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.443566] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7c1c93-5692-4546-9b54-4011872a824d taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.443790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.443790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.443998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.444368] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.444466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.444644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.444723] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.444806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.444898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.445071] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7c1c93-5692-4546-9b54-4011872a824d taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.445172] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.445231] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.445383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.445526] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.445617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.445672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.445809] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.445885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.445965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.446068] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b7c1c93-5692-4546-9b54-4011872a824d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.482434] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.482434] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.482434] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.482434] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.482434] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.482686] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.482686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.482782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.482847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.482921] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.483016] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 already deleted. [ 829.483102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.483676] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.483790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.483893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.484013] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.484095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.484278] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.484379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.484439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.484721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.484786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.484874] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be deleted. [ 829.519706] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.519861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.519929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.520172] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.520534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.520534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.891864] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.892137] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.892264] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.892543] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.892691] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.892869] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port ce4c61da-cfaf-4d8a-94e5-f63fb7f13310 not found, creating... [ 829.893161] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.893315] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.893451] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.893690] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.893829] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.894135] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.894293] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.894403] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.894609] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.894739] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.897729] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: ce4c61da-cfaf-4d8a-94e5-f63fb7f13310 is going to be created. [ 829.919578] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.919842] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.919942] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.920274] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.920510] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.920743] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-ce4c61da-cfaf-4d8a-94e5-f63fb7f13310" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.948806] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b7c1c93-5692-4546-9b54-4011872a824d: rpc.has_security_group_logging(os_id): False [ 829.961929] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-346 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.962367] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.962543] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.964228] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.964228] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.964228] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.964228] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.964228] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.964228] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.964228] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.964605] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.964605] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.964677] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.965032] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.965032] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.965032] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.980239] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.980437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.980548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.980879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.981018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.981382] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.981535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.981630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.981865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.981964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.982188] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.982327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.982639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.982639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.982639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.982860] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.982969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.983082] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.983268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.983347] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.983455] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b7c1c93-5692-4546-9b54-4011872a824d is going to be created. [ 829.989753] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.989970] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.990129] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.990340] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.990700] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-f77a3e68-edef-4f31-b7f2-f9672bd1c2b9 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.990881] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-f77a3e68-edef-4f31-b7f2-f9672bd1c2b9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.990997] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-f77a3e68-edef-4f31-b7f2-f9672bd1c2b9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.991353] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-f77a3e68-edef-4f31-b7f2-f9672bd1c2b9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.991680] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f77a3e68-edef-4f31-b7f2-f9672bd1c2b9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.071111] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.071336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.071386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.071586] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.071893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.099812] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b7c1c93-5692-4546-9b54-4011872a824d in Status: IN_PROGRESS for 2s [ 830.101730] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: SUCCESS [ 830.101999] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.109159] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 830.109387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.132402] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: SUCCESS [ 830.132653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.154574] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: SUCCESS [ 830.154790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.159513] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 830.159844] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb deletion is rescheduled due to dependency. [ 830.159996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.248446] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 830.248682] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.272510] env[65359]: INFO networking_nsxv3.common.synchronization [None req-0849ad26-e454-4f42-a849-1ca5cf348ac6 None None] Enqueued Resource ID: d9fb6daf-b033-49ae-9645-698bddc96ad6 with Priority: HIGHEST for action port [ 830.273082] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9fb6daf-b033-49ae-9645-698bddc96ad6 with Priority: HIGHEST for action port [ 830.273427] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9fb6daf-b033-49ae-9645-698bddc96ad6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.273552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9fb6daf-b033-49ae-9645-698bddc96ad6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.273617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9fb6daf-b033-49ae-9645-698bddc96ad6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.273870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9fb6daf-b033-49ae-9645-698bddc96ad6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.273954] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9fb6daf-b033-49ae-9645-698bddc96ad6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.494596] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.494830] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.494957] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.495275] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.495421] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.495573] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port f77a3e68-edef-4f31-b7f2-f9672bd1c2b9 not found, creating... [ 830.495865] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.495980] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.496108] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.496323] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.496453] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.496730] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.496885] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.497000] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.497220] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.497342] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.497474] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: f77a3e68-edef-4f31-b7f2-f9672bd1c2b9 is going to be created. [ 830.517168] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.517461] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.517550] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.517752] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.517975] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.518225] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-f77a3e68-edef-4f31-b7f2-f9672bd1c2b9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.592737] env[65359]: INFO networking_nsxv3.common.synchronization [req-434ac87d-09c9-480e-833e-54f8a51a2741 req-e7c20a0f-cfdc-4f9e-af1d-30e306e0509f service nova] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_rules [ 830.592955] env[65359]: INFO networking_nsxv3.common.synchronization [req-434ac87d-09c9-480e-833e-54f8a51a2741 req-e7c20a0f-cfdc-4f9e-af1d-30e306e0509f service nova] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 830.593109] env[65359]: INFO networking_nsxv3.common.synchronization [req-434ac87d-09c9-480e-833e-54f8a51a2741 req-e7c20a0f-cfdc-4f9e-af1d-30e306e0509f service nova] Enqueued Resource ID: ce4c61da-cfaf-4d8a-94e5-f63fb7f13310 with Priority: HIGHEST for action port [ 830.593645] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_rules [ 830.593772] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 830.593868] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4c61da-cfaf-4d8a-94e5-f63fb7f13310 with Priority: HIGHEST for action port [ 830.594232] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.594380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.594451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.594712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.594799] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.595715] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.595835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.595879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.596029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.596186] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.596282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.596344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.596486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.596786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.596786] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.597750] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce4c61da-cfaf-4d8a-94e5-f63fb7f13310 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.600826] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce4c61da-cfaf-4d8a-94e5-f63fb7f13310" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.600921] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce4c61da-cfaf-4d8a-94e5-f63fb7f13310" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.601120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce4c61da-cfaf-4d8a-94e5-f63fb7f13310" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.601202] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce4c61da-cfaf-4d8a-94e5-f63fb7f13310',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.776041] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9fb6daf-b033-49ae-9645-698bddc96ad6 [ 830.779045] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.779045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.779045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.779045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.779045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.779045] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9fb6daf-b033-49ae-9645-698bddc96ad6 already deleted. [ 830.779045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9fb6daf-b033-49ae-9645-698bddc96ad6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.103351] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.110028] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.110028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.110028] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce4c61da-cfaf-4d8a-94e5-f63fb7f13310 with status ACTIVE [ 831.110028] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.110028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.110028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.110028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.110028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.110028] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.110028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.110028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.110028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.110028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.110028] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.113608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.113608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.113608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.113608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.113608] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce4c61da-cfaf-4d8a-94e5-f63fb7f13310 is going to be updated. [ 831.134879] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.135088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.135136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.135314] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.135450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.135635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce4c61da-cfaf-4d8a-94e5-f63fb7f13310" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.259861] env[65359]: INFO networking_nsxv3.common.synchronization [req-e1150eb5-12fa-4cc4-99c9-b699f7b7ae71 req-ecbcba68-5393-46d9-af8f-a58f1fcdff83 service nova] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_rules [ 831.259861] env[65359]: INFO networking_nsxv3.common.synchronization [req-e1150eb5-12fa-4cc4-99c9-b699f7b7ae71 req-ecbcba68-5393-46d9-af8f-a58f1fcdff83 service nova] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 831.259861] env[65359]: INFO networking_nsxv3.common.synchronization [req-e1150eb5-12fa-4cc4-99c9-b699f7b7ae71 req-ecbcba68-5393-46d9-af8f-a58f1fcdff83 service nova] Enqueued Resource ID: f77a3e68-edef-4f31-b7f2-f9672bd1c2b9 with Priority: HIGHEST for action port [ 831.259861] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_rules [ 831.259861] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 831.259861] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77a3e68-edef-4f31-b7f2-f9672bd1c2b9 with Priority: HIGHEST for action port [ 831.259861] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.259861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.259861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.260357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.260357] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.261099] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.261248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.261402] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.261480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.261657] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.261747] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.261941] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.262179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.262179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.262262] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.264337] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-f77a3e68-edef-4f31-b7f2-f9672bd1c2b9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.264893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f77a3e68-edef-4f31-b7f2-f9672bd1c2b9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.264893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f77a3e68-edef-4f31-b7f2-f9672bd1c2b9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.265081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f77a3e68-edef-4f31-b7f2-f9672bd1c2b9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.265136] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f77a3e68-edef-4f31-b7f2-f9672bd1c2b9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.613642] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.716107] env[65359]: INFO networking_nsxv3.common.synchronization [req-45e1f6b5-a425-4d95-87d8-46bc4c0c8a52 req-45a5c1e0-11c0-4467-b423-7a3a900a6deb tempest-ServersWithSpecificFlavorTestJSON-1171930916 tempest-ServersWithSpecificFlavorTestJSON-1171930916-project-member] Enqueued Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_members [ 831.716633] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_members [ 831.716942] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.717204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.717287] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.717479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.717632] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.717730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.717790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.717935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.718032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.718122] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.767067] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.768052] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.768168] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.768334] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f77a3e68-edef-4f31-b7f2-f9672bd1c2b9 with status ACTIVE [ 831.768492] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.768601] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.768668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.768863] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.768954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.769141] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.769237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.769298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.769458] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.769536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.770241] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.770351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.770410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.770567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.770632] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.770723] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f77a3e68-edef-4f31-b7f2-f9672bd1c2b9 is going to be updated. [ 831.809126] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.809284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.809423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.809570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.809706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.809904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f77a3e68-edef-4f31-b7f2-f9672bd1c2b9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.064603] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-455 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.064784] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-455" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.064908] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-455" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.065304] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-455" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.065612] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.065778] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.065898] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.066445] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.066612] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.067307] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.067435] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.067545] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.067652] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.067806] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.067860] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.068014] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.087944] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.088417] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 832.088417] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.088417] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-455" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.088732] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-64f9d672-b0c1-4428-ac37-2b1c23361952 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.088903] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-64f9d672-b0c1-4428-ac37-2b1c23361952" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.089033] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-64f9d672-b0c1-4428-ac37-2b1c23361952" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.089437] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-64f9d672-b0c1-4428-ac37-2b1c23361952" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.089594] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64f9d672-b0c1-4428-ac37-2b1c23361952',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.112134] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b7c1c93-5692-4546-9b54-4011872a824d in Status: SUCCESS [ 832.112775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.116418] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.116564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.116642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.116860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.116948] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.117061] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be created. [ 832.147043] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.147043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.147043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.147310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.147310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.158205] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: UNINITIALIZED for 2s [ 832.221283] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.221503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.221503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.222316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.222680] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.222680] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.222805] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.222856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.223044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.223116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.223207] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 is going to be deleted. [ 832.259971] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.260248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.260475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.260668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.260814] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.260975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.273557] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.334025] env[65359]: INFO networking_nsxv3.common.synchronization [None req-2d0f25e5-a752-49fc-9c59-ca6781dac9d7 None None] Enqueued Resource ID: f3af1861-a6c0-4bdb-a76a-e253e80814bf with Priority: HIGHEST for action port [ 832.334025] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3af1861-a6c0-4bdb-a76a-e253e80814bf with Priority: HIGHEST for action port [ 832.334598] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3af1861-a6c0-4bdb-a76a-e253e80814bf taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.334874] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3af1861-a6c0-4bdb-a76a-e253e80814bf" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.335039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3af1861-a6c0-4bdb-a76a-e253e80814bf" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.335363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3af1861-a6c0-4bdb-a76a-e253e80814bf" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.335537] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3af1861-a6c0-4bdb-a76a-e253e80814bf',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.593562] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.593794] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.593921] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.594313] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.594469] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.594625] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 64f9d672-b0c1-4428-ac37-2b1c23361952 not found, creating... [ 832.594922] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.595061] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.595165] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.595357] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.595503] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.595776] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.595927] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.596051] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.596262] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.596387] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.596521] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 64f9d672-b0c1-4428-ac37-2b1c23361952 is going to be created. [ 832.621337] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.622064] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.622196] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.622621] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.622904] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.623186] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-64f9d672-b0c1-4428-ac37-2b1c23361952" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.778733] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.779858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.780172] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.780325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.780488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.780637] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be created. [ 832.825597] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.825777] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.825857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.830214] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.830429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.838400] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3af1861-a6c0-4bdb-a76a-e253e80814bf [ 832.838794] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.838975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.839105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.839399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.839609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.839655] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3af1861-a6c0-4bdb-a76a-e253e80814bf already deleted. [ 832.839869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3af1861-a6c0-4bdb-a76a-e253e80814bf" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.849165] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: UNINITIALIZED for 2s [ 833.362421] env[65359]: INFO networking_nsxv3.common.synchronization [req-45e1f6b5-a425-4d95-87d8-46bc4c0c8a52 req-f0709baf-9c56-4163-98bb-039226a2eb0b service nova] Enqueued Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_rules [ 833.362691] env[65359]: INFO networking_nsxv3.common.synchronization [req-45e1f6b5-a425-4d95-87d8-46bc4c0c8a52 req-f0709baf-9c56-4163-98bb-039226a2eb0b service nova] Enqueued Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_members [ 833.362751] env[65359]: INFO networking_nsxv3.common.synchronization [req-45e1f6b5-a425-4d95-87d8-46bc4c0c8a52 req-f0709baf-9c56-4163-98bb-039226a2eb0b service nova] Enqueued Resource ID: 64f9d672-b0c1-4428-ac37-2b1c23361952 with Priority: HIGHEST for action port [ 833.363350] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_rules [ 833.363522] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_members [ 833.363634] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f9d672-b0c1-4428-ac37-2b1c23361952 with Priority: HIGHEST for action port [ 833.363926] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.364179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.364179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.364379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.364467] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.365393] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.365516] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.365583] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.366307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.366307] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.366307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.366307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.366307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.366594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.366594] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.367649] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-64f9d672-b0c1-4428-ac37-2b1c23361952 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.367649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64f9d672-b0c1-4428-ac37-2b1c23361952" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.367649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64f9d672-b0c1-4428-ac37-2b1c23361952" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.367649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64f9d672-b0c1-4428-ac37-2b1c23361952" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.367649] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64f9d672-b0c1-4428-ac37-2b1c23361952',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.869439] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.871046] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.871171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.871302] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64f9d672-b0c1-4428-ac37-2b1c23361952 with status ACTIVE [ 833.871492] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.871608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.871668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.871954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.872064] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.872240] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.872336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.872398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.872562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.872637] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.872816] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.872907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.872967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.873121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.873184] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.873268] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64f9d672-b0c1-4428-ac37-2b1c23361952 is going to be updated. [ 833.901385] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.901537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.902845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.902845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.902845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.902845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64f9d672-b0c1-4428-ac37-2b1c23361952" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.170138] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 834.170138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.170296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.170562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.171179] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.171291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.171335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.171986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.171986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.171986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.171986] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.375838] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.676112] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.676279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.676352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.676572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.676744] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.676849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.676913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.677074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.677162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.677249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.677396] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.677487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.677548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.677886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.678049] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.678147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.678208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.678360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.678437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.678518] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.678606] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.861133] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 834.861269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.862760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.862760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.862760] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.862760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.862760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.862760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.862760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.862760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.862760] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.878703] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.878859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.878966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.879130] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.879225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.879327] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 is going to be created. [ 834.906719] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.906873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.907079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.907187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.907345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.917487] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 in Status: UNINITIALIZED for 2s [ 835.182406] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3: rpc.has_security_group_logging(os_id): False [ 835.201777] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.201975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.202058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.202276] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.202373] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.202568] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.202744] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.202853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.202964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.203053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.203296] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.203398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.203506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.203588] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.203683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.203839] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.203915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.203970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.204113] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.204185] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.204259] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be created. [ 835.271083] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.271251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.271348] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.271635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.271797] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.284734] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 2s [ 835.365874] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.366094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.366140] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.366400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.366600] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.366732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.366816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.367015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.367126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.367234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.367410] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.367515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.367591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.367779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.367938] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.368066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.368144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.368305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.368499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.368631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.368677] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.874860] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4dca704-f8c2-494f-bbf6-802020c49b4b: rpc.has_security_group_logging(os_id): False [ 835.895208] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.895364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.895428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.895646] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.895738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.895958] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.896072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.896126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.896274] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.896349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.896521] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.896612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.896668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.896804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.896877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.897072] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.897164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.897224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.897360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.897432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.897513] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be created. [ 835.989463] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.989642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.989642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.989813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.990167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.006512] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: IN_PROGRESS for 2s [ 836.934150] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 in Status: SUCCESS [ 836.934527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.935098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.935098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.935275] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.935275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.935424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.935661] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.935661] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.936235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.936235] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.297177] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 837.297404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.438241] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.942905] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f33a6cb0-88e0-45c4-8990-6da48fb9f1f5: rpc.has_security_group_logging(os_id): False [ 837.968029] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.968029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.968029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.968029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.968029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.968029] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.968029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.968029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.968029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.968029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.968029] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 is going to be created. [ 838.025535] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 838.025535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.046166] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.046441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.046441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.046702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.046931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.063460] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 in Status: IN_PROGRESS for 2s [ 838.364406] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 838.364518] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 840.085264] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 in Status: SUCCESS [ 840.085626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.828585] env[65359]: INFO networking_nsxv3.common.synchronization [req-7d4efc31-96e6-4912-99b6-db3e1f641318 req-3a197e1f-a02b-48e2-a728-90c43a79c787 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 840.829170] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 840.829510] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.829625] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.829714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.829990] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.830197] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.830302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.830365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.830521] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.830610] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.830701] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.156884] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-970 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.157303] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.157303] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.157548] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.157859] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.159188] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.159304] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.159550] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.159710] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.160181] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.160181] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.160329] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.160379] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.160573] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.160652] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.160708] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.183724] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.184455] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 841.184455] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.184455] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.184709] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-5861b0ae-ce51-4385-a142-8147432f5cc4 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.184834] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.184901] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.188349] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.188349] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5861b0ae-ce51-4385-a142-8147432f5cc4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.332916] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.333174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.333254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.333498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.333589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.333874] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.333971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.334133] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.334325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.334384] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.334479] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 already deleted. [ 841.334553] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.382043] env[65359]: INFO networking_nsxv3.common.synchronization [req-2ad0cb2f-7f97-4815-9d19-a4116231a90b req-f9f40ee9-e808-4ef7-901b-8adc58f34ac9 tempest-ServerMetadataNegativeTestJSON-1627460128 tempest-ServerMetadataNegativeTestJSON-1627460128-project-member] Enqueued Resource ID: 1b7c1c93-5692-4546-9b54-4011872a824d with Priority: HIGHEST for action security_group_members [ 841.382534] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7c1c93-5692-4546-9b54-4011872a824d with Priority: HIGHEST for action security_group_members [ 841.382892] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7c1c93-5692-4546-9b54-4011872a824d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.383032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.383103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.383301] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.383470] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.383577] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.383637] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.383789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.383872] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.383982] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7c1c93-5692-4546-9b54-4011872a824d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.690438] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.690822] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.690945] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.691227] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.691535] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.691535] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 5861b0ae-ce51-4385-a142-8147432f5cc4 not found, creating... [ 841.691796] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.692028] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.692165] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.692383] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.692515] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.692790] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.692955] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.693292] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.693568] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.693737] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.693855] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 5861b0ae-ce51-4385-a142-8147432f5cc4 is going to be created. [ 841.715798] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.716037] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.716147] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.716430] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.716652] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.716883] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.886731] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.887633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.887633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.887633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.887633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.887633] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.887633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.887951] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.887951] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.887951] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.887951] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7c1c93-5692-4546-9b54-4011872a824d is going to be updated. [ 841.933764] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.933996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.933996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.934208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.934350] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.949972] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7c1c93-5692-4546-9b54-4011872a824d in Status: IN_PROGRESS for 2s [ 842.434745] env[65359]: INFO networking_nsxv3.common.synchronization [req-7d4efc31-96e6-4912-99b6-db3e1f641318 req-f104e67b-dc06-4adf-962e-31a2ca2f4fd9 service nova] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_rules [ 842.435073] env[65359]: INFO networking_nsxv3.common.synchronization [req-7d4efc31-96e6-4912-99b6-db3e1f641318 req-f104e67b-dc06-4adf-962e-31a2ca2f4fd9 service nova] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 842.435073] env[65359]: INFO networking_nsxv3.common.synchronization [req-7d4efc31-96e6-4912-99b6-db3e1f641318 req-f104e67b-dc06-4adf-962e-31a2ca2f4fd9 service nova] Enqueued Resource ID: 5861b0ae-ce51-4385-a142-8147432f5cc4 with Priority: HIGHEST for action port [ 842.435852] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_rules [ 842.435852] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 842.435852] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5861b0ae-ce51-4385-a142-8147432f5cc4 with Priority: HIGHEST for action port [ 842.436300] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.436300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.436300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.436510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.436510] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.437325] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.438136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.438136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.438136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.438136] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.438136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.438136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.438136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.438561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.438561] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.439424] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-5861b0ae-ce51-4385-a142-8147432f5cc4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.439541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.439596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.441029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.441029] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5861b0ae-ce51-4385-a142-8147432f5cc4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.943130] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.944142] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.944263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.944447] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5861b0ae-ce51-4385-a142-8147432f5cc4 with status ACTIVE [ 842.944609] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.944964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.944964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.944964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.945133] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.945229] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.945327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.945444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.945537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.945612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.945789] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.945881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.945938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.950302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.950389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.950566] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5861b0ae-ce51-4385-a142-8147432f5cc4 is going to be updated. [ 842.972823] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.972823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.972823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.972823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.973077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.973077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.453037] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.605202] env[65359]: INFO networking_nsxv3.common.synchronization [req-c7a0d53e-e4fc-46f5-8725-581e9ca17a35 req-d14a041d-0b3d-4539-a837-3ac666b87eea tempest-ServerRescueNegativeTestJSON-174363340 tempest-ServerRescueNegativeTestJSON-174363340-project-member] Enqueued Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_members [ 843.605202] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_members [ 843.605202] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.605202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.605202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.605813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.606174] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.606508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.606704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.607015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.607494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.607731] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.959849] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.960091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.960264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.962188] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.962188] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.962188] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be created. [ 843.964034] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7c1c93-5692-4546-9b54-4011872a824d in Status: SUCCESS [ 843.964414] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7c1c93-5692-4546-9b54-4011872a824d deletion is rescheduled due to dependency. [ 843.964686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.993954] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.994774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.994836] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.995209] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.995305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.008363] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: UNINITIALIZED for 2s [ 844.014022] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.014022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-624" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.014022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-624" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.014022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-624" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.014734] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.015604] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.015604] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.015604] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.015604] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.016562] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.016562] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.016562] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.016562] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.016562] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.016562] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.016849] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.036655] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.036826] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 844.036962] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.037174] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-624" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.037487] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-65e41cc1-2191-4ce4-b634-cd0e9f6ca5be taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.037654] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-65e41cc1-2191-4ce4-b634-cd0e9f6ca5be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.037770] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-65e41cc1-2191-4ce4-b634-cd0e9f6ca5be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.038149] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-65e41cc1-2191-4ce4-b634-cd0e9f6ca5be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.038300] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65e41cc1-2191-4ce4-b634-cd0e9f6ca5be',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.110557] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.110770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.111503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.111503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.111503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.111667] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.111795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.111907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.114861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.114861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.114861] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4a73e88-8afb-4866-a66b-2583f493db5e already deleted. [ 844.114861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.541082] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.541436] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.541436] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.541706] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.541845] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.542066] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 65e41cc1-2191-4ce4-b634-cd0e9f6ca5be not found, creating... [ 844.542362] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.542515] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.542625] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.542833] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.542982] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.543628] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.543628] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.543628] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.543815] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.543870] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.543996] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 65e41cc1-2191-4ce4-b634-cd0e9f6ca5be is going to be created. [ 844.564274] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.564563] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.564770] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.565112] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.565356] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.565597] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-65e41cc1-2191-4ce4-b634-cd0e9f6ca5be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.676454] env[65359]: INFO networking_nsxv3.common.synchronization [req-512c591c-e92f-4ac2-b98c-4c130c332933 req-fca856cd-d507-4ccb-8cc8-e6b64ed6fbc5 tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 844.676454] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 844.676717] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.676859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.676938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.677182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.678769] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.678769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.678769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.678769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.678769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.678769] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.182046] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.182046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.182046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.182046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.182046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.182421] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.182421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.182421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.182421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.182599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.182599] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be updated. [ 845.212872] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.212872] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.212872] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.213118] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.214037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.223868] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 2s [ 845.306415] env[65359]: INFO networking_nsxv3.common.synchronization [req-c7a0d53e-e4fc-46f5-8725-581e9ca17a35 req-dc5de115-0df1-4bff-aa2e-a31839962dcf service nova] Enqueued Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_rules [ 845.306557] env[65359]: INFO networking_nsxv3.common.synchronization [req-c7a0d53e-e4fc-46f5-8725-581e9ca17a35 req-dc5de115-0df1-4bff-aa2e-a31839962dcf service nova] Enqueued Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_members [ 845.306557] env[65359]: INFO networking_nsxv3.common.synchronization [req-c7a0d53e-e4fc-46f5-8725-581e9ca17a35 req-dc5de115-0df1-4bff-aa2e-a31839962dcf service nova] Enqueued Resource ID: 65e41cc1-2191-4ce4-b634-cd0e9f6ca5be with Priority: HIGHEST for action port [ 845.307197] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_rules [ 845.307307] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_members [ 845.307307] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65e41cc1-2191-4ce4-b634-cd0e9f6ca5be with Priority: HIGHEST for action port [ 845.308654] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.308654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.308654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.308654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.308654] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.310915] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.310915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.310915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.310915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.312199] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.312906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.312906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.312906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.314358] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.314358] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.314492] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-65e41cc1-2191-4ce4-b634-cd0e9f6ca5be taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.314569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65e41cc1-2191-4ce4-b634-cd0e9f6ca5be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.314867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65e41cc1-2191-4ce4-b634-cd0e9f6ca5be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.314867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65e41cc1-2191-4ce4-b634-cd0e9f6ca5be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.314867] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65e41cc1-2191-4ce4-b634-cd0e9f6ca5be',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.810743] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.811063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.817362] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.818327] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65e41cc1-2191-4ce4-b634-cd0e9f6ca5be with status ACTIVE [ 845.818525] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.818649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.819439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.819439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.819439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.819439] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.819439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.819439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.819685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.819685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.819748] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.819807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.819865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.819994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.820074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.820155] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65e41cc1-2191-4ce4-b634-cd0e9f6ca5be is going to be updated. [ 845.845281] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.845354] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.845428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.845641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.845785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.845949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65e41cc1-2191-4ce4-b634-cd0e9f6ca5be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.042862] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 846.043096] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.043264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.043483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.043675] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.043792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.043858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.044192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.044192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.044192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.044350] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.311348] env[65359]: INFO networking_nsxv3.common.synchronization [req-e9a76d76-21d9-41f4-bff1-660a4d38082c req-bbb4a7a1-ae59-41f4-be3c-81a13c5c3b02 tempest-ServerRescueNegativeTestJSON-174363340 tempest-ServerRescueNegativeTestJSON-174363340-project-member] Enqueued Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_members [ 846.311883] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_members [ 846.312262] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.312367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.322205] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.547494] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.547494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.547812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.547846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.549135] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.549135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.549135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.549135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.549135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.549135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.549135] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.549135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.549135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.549537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.549537] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.549537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.549682] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.549875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.549994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.550120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.550168] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.780512] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.780967] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-624" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.781297] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-624" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.782244] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-624" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.782756] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.783189] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.783477] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.783894] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.784247] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.784644] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.784912] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 846.785188] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 846.785469] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 846.785746] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.785988] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 846.786276] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.814331] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.814713] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 846.814929] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.815259] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-624" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.816081] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-3e1dc6de-0e73-45b0-8e68-d551964f867a taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.816390] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-3e1dc6de-0e73-45b0-8e68-d551964f867a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.816499] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-3e1dc6de-0e73-45b0-8e68-d551964f867a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.816881] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-3e1dc6de-0e73-45b0-8e68-d551964f867a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.817242] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e1dc6de-0e73-45b0-8e68-d551964f867a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.825274] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.825499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.825562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.825844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.825951] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.826088] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4a73e88-8afb-4866-a66b-2583f493db5e is going to be created. [ 846.859727] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.859727] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.859727] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.859727] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.859727] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.870832] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4a73e88-8afb-4866-a66b-2583f493db5e in Status: UNINITIALIZED for 2s [ 847.052562] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6: rpc.has_security_group_logging(os_id): False [ 847.074867] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.075111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.075111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.075326] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.075455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.075616] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.075714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.075775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.075929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.075993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.076231] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.076330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.076380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.076524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.076596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.076768] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.076856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.076906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.077363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.077363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.077363] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be created. [ 847.162032] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.162032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.162032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.162032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.162032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.175178] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 847.237076] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 847.237501] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 deletion is rescheduled due to dependency. [ 847.237704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.320465] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.320703] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.320827] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.321147] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.321520] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.321520] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 3e1dc6de-0e73-45b0-8e68-d551964f867a not found, creating... [ 847.321776] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.321970] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.322133] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.322332] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.322487] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.322983] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.322983] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.323124] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.323380] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.323497] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.323706] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 3e1dc6de-0e73-45b0-8e68-d551964f867a is going to be created. [ 847.353430] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.353638] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.353763] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.354136] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.354455] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.354696] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-3e1dc6de-0e73-45b0-8e68-d551964f867a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.066525] env[65359]: INFO networking_nsxv3.common.synchronization [req-e9a76d76-21d9-41f4-bff1-660a4d38082c req-3a4acbc7-426a-44c8-9714-2b9544b72dec service nova] Enqueued Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_rules [ 848.067461] env[65359]: INFO networking_nsxv3.common.synchronization [req-e9a76d76-21d9-41f4-bff1-660a4d38082c req-3a4acbc7-426a-44c8-9714-2b9544b72dec service nova] Enqueued Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_members [ 848.067461] env[65359]: INFO networking_nsxv3.common.synchronization [req-e9a76d76-21d9-41f4-bff1-660a4d38082c req-3a4acbc7-426a-44c8-9714-2b9544b72dec service nova] Enqueued Resource ID: 3e1dc6de-0e73-45b0-8e68-d551964f867a with Priority: HIGHEST for action port [ 848.067461] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_rules [ 848.067461] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_members [ 848.067612] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e1dc6de-0e73-45b0-8e68-d551964f867a with Priority: HIGHEST for action port [ 848.067779] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.067887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.068076] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.068200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.068334] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e1dc6de-0e73-45b0-8e68-d551964f867a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.068432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e1dc6de-0e73-45b0-8e68-d551964f867a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.068491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e1dc6de-0e73-45b0-8e68-d551964f867a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.068695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e1dc6de-0e73-45b0-8e68-d551964f867a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.068775] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e1dc6de-0e73-45b0-8e68-d551964f867a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.573542] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e1dc6de-0e73-45b0-8e68-d551964f867a with status ACTIVE [ 848.573783] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.573918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.574019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.574308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.574394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.574583] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.574706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.574771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.574924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.575100] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.575308] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.575416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.575470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.575667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.575745] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.575860] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e1dc6de-0e73-45b0-8e68-d551964f867a is going to be updated. [ 848.609523] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.609796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.609920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.610261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.610485] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.610748] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e1dc6de-0e73-45b0-8e68-d551964f867a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.884890] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4a73e88-8afb-4866-a66b-2583f493db5e in Status: SUCCESS [ 848.885233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.885714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.886051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.886277] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.886401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.886471] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.886651] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.886735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.886824] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.886944] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.889039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.889039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.889039] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.889039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.889039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.889039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.889039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.889039] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.189636] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 849.190023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.363692] env[65359]: INFO networking_nsxv3.common.synchronization [req-9973921e-458e-4406-97d4-fdd39752284b req-81cc00bf-2392-4409-9d4c-731965e781da tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 with Priority: HIGHEST for action security_group_members [ 849.364768] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 with Priority: HIGHEST for action security_group_members [ 849.364768] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1f01646-6e50-4a59-a98b-3f8bba190b64 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.364768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.365056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.365206] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.365376] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.365557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.365557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.365701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.365789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.365887] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1f01646-6e50-4a59-a98b-3f8bba190b64',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.390420] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.390613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.390787] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.521193] env[65359]: INFO networking_nsxv3.common.synchronization [req-12c38a2a-94ef-490f-98ed-a73951fc70fa req-46e1ebcc-997f-43bc-bb8a-8887c1ce689e tempest-ServersTestManualDisk-1454548057 tempest-ServersTestManualDisk-1454548057-project-member] Enqueued Resource ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 with Priority: HIGHEST for action security_group_members [ 849.521249] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 with Priority: HIGHEST for action security_group_members [ 849.521551] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.521679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.521776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.522321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.522404] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.522510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.522567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.522718] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.522812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.522906] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3711d124-9bf8-4fa4-9c53-ee6c21e9b344',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.869035] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.869035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.869035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.869248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.895031] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.895718] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.897031] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.897031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.897031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.897031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.897031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.897031] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 is going to be updated. [ 849.929684] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.929684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.929684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.929684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.929684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.941871] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 in Status: IN_PROGRESS for 2s [ 849.951671] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.951848] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-526" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.951994] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-526" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.952325] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-526" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.952600] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.952799] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.952908] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.957032] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.957032] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.957032] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.957032] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.957032] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.957032] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.957032] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.957032] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.957032] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.962911] env[65359]: INFO networking_nsxv3.common.synchronization [None req-96d27199-a2a7-4e9c-a78d-0c169784d5aa None None] Enqueued Resource ID: ea6c99d6-09f3-4819-ae74-a6402c54b613 with Priority: HIGHEST for action port [ 849.964645] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea6c99d6-09f3-4819-ae74-a6402c54b613 with Priority: HIGHEST for action port [ 849.965744] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea6c99d6-09f3-4819-ae74-a6402c54b613 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.966103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea6c99d6-09f3-4819-ae74-a6402c54b613" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.966311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea6c99d6-09f3-4819-ae74-a6402c54b613" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.966735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea6c99d6-09f3-4819-ae74-a6402c54b613" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.966946] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea6c99d6-09f3-4819-ae74-a6402c54b613',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.984679] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.984875] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 849.985022] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.985212] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-526" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.985539] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-4479a4ac-da5d-4d9a-8e82-42607414fcfd taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.985730] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-4479a4ac-da5d-4d9a-8e82-42607414fcfd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.985808] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-4479a4ac-da5d-4d9a-8e82-42607414fcfd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.986385] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-4479a4ac-da5d-4d9a-8e82-42607414fcfd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.986477] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4479a4ac-da5d-4d9a-8e82-42607414fcfd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.026247] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.026569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.026667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.026975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.027125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.027370] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.027601] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.027601] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.027702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.027776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.027866] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 already deleted. [ 850.027949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.398887] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.398887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.398887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.399401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.399401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.399401] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4a73e88-8afb-4866-a66b-2583f493db5e is going to be updated. [ 850.434343] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.434543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.434611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.434770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.434926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.445965] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4a73e88-8afb-4866-a66b-2583f493db5e in Status: IN_PROGRESS for 2s [ 850.472617] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea6c99d6-09f3-4819-ae74-a6402c54b613 [ 850.472859] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.472996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.473163] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.473396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.473496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.473973] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea6c99d6-09f3-4819-ae74-a6402c54b613 already deleted. [ 850.473973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea6c99d6-09f3-4819-ae74-a6402c54b613" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.490443] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.490532] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.490682] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.490942] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.491110] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.491271] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 4479a4ac-da5d-4d9a-8e82-42607414fcfd not found, creating... [ 850.491553] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.491712] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.491847] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.492156] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.492315] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.492634] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.492788] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.492900] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.493741] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.493741] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.493741] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 4479a4ac-da5d-4d9a-8e82-42607414fcfd is going to be created. [ 850.519233] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.519475] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.519631] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.519951] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.520590] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.520850] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-4479a4ac-da5d-4d9a-8e82-42607414fcfd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.393722] env[65359]: INFO networking_nsxv3.common.synchronization [req-12c38a2a-94ef-490f-98ed-a73951fc70fa req-21c4d3f3-acb6-454d-87b5-f3e2b979aaf8 service nova] Enqueued Resource ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 with Priority: HIGHEST for action security_group_rules [ 851.394308] env[65359]: INFO networking_nsxv3.common.synchronization [req-12c38a2a-94ef-490f-98ed-a73951fc70fa req-21c4d3f3-acb6-454d-87b5-f3e2b979aaf8 service nova] Enqueued Resource ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 with Priority: HIGHEST for action security_group_members [ 851.394308] env[65359]: INFO networking_nsxv3.common.synchronization [req-12c38a2a-94ef-490f-98ed-a73951fc70fa req-21c4d3f3-acb6-454d-87b5-f3e2b979aaf8 service nova] Enqueued Resource ID: 4479a4ac-da5d-4d9a-8e82-42607414fcfd with Priority: HIGHEST for action port [ 851.394662] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 with Priority: HIGHEST for action security_group_rules [ 851.397703] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 with Priority: HIGHEST for action security_group_members [ 851.397866] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4479a4ac-da5d-4d9a-8e82-42607414fcfd with Priority: HIGHEST for action port [ 851.398200] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.398344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.398436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.398909] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.398909] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3711d124-9bf8-4fa4-9c53-ee6c21e9b344',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.400743] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.400913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.401676] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.401819] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.403196] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.403196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.403296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.403433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.403524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.403621] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3711d124-9bf8-4fa4-9c53-ee6c21e9b344',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.404739] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-4479a4ac-da5d-4d9a-8e82-42607414fcfd taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.404864] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4479a4ac-da5d-4d9a-8e82-42607414fcfd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.404933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4479a4ac-da5d-4d9a-8e82-42607414fcfd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.405132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4479a4ac-da5d-4d9a-8e82-42607414fcfd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.405222] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4479a4ac-da5d-4d9a-8e82-42607414fcfd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.909657] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.909657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.911034] env[65359]: INFO networking_nsxv3.common.synchronization [None req-1c9047f5-44a1-4f3e-8b96-bdcb0e9ebed1 None None] Enqueued Resource ID: 9e057725-909b-4a77-97a2-d33485a86d3e with Priority: HIGHEST for action port [ 851.911034] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3711d124-9bf8-4fa4-9c53-ee6c21e9b344',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.911673] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e057725-909b-4a77-97a2-d33485a86d3e with Priority: HIGHEST for action port [ 851.912217] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4479a4ac-da5d-4d9a-8e82-42607414fcfd with status ACTIVE [ 851.912310] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.912409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.912468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.912700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.912795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.912973] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.916020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.916020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.916020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.916020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.916020] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.916020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.916020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.916020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.916020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.916020] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4479a4ac-da5d-4d9a-8e82-42607414fcfd is going to be updated. [ 851.916020] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e057725-909b-4a77-97a2-d33485a86d3e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.916020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e057725-909b-4a77-97a2-d33485a86d3e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.916020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e057725-909b-4a77-97a2-d33485a86d3e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.916020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e057725-909b-4a77-97a2-d33485a86d3e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.916020] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e057725-909b-4a77-97a2-d33485a86d3e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.942376] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.942747] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.943756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.943756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.943756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.943756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4479a4ac-da5d-4d9a-8e82-42607414fcfd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.954367] env[65359]: INFO networking_nsxv3.common.synchronization [req-b7c1e5ee-282b-4161-b10a-c47531d42b1d req-2842cd37-5655-4d96-bf07-d6b2279b7556 tempest-ServerActionsTestJSON-975876043 tempest-ServerActionsTestJSON-975876043-project-member] Enqueued Resource ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d with Priority: HIGHEST for action security_group_members [ 851.955321] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d with Priority: HIGHEST for action security_group_members [ 851.958337] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.958337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.958337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.958337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.958337] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.958337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.958337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.958337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.958337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.958698] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.963847] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 in Status: SUCCESS [ 851.963847] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1f01646-6e50-4a59-a98b-3f8bba190b64 deletion is rescheduled due to dependency. [ 851.963847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1f01646-6e50-4a59-a98b-3f8bba190b64" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.418256] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3711d124-9bf8-4fa4-9c53-ee6c21e9b344',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.420052] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e057725-909b-4a77-97a2-d33485a86d3e [ 852.420317] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.420482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.422129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.422815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.422815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.422815] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e057725-909b-4a77-97a2-d33485a86d3e already deleted. [ 852.422925] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e057725-909b-4a77-97a2-d33485a86d3e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.425959] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-227 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.426153] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.426274] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.426514] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.426761] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.426909] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.427043] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.427260] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.427785] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.428096] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.428186] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.428387] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.428387] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.428547] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.428606] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.428733] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.450117] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.450413] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 852.450472] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.450643] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.451574] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.451771] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.451894] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.452401] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.452551] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.460684] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.460936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.461212] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.461557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.461659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.462050] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.462050] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.462050] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.462287] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.462287] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.462406] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d already deleted. [ 852.462846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.465490] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4a73e88-8afb-4866-a66b-2583f493db5e in Status: SUCCESS [ 852.466641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.466641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.466641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.466905] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.466905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.466905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.467116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.467116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.467222] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.822708] env[65359]: INFO networking_nsxv3.common.synchronization [None req-cf79e86f-22b2-4336-87ac-b956d84e86d3 tempest-ServerActionsTestOtherB-968321773 tempest-ServerActionsTestOtherB-968321773-project-member] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_rules [ 852.822708] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_rules [ 852.822708] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.822860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.822860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.823172] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.823269] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.925236] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.925236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.925236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.925236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.925236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.925236] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 is going to be created. [ 852.951218] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.951415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.951489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.951728] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.951909] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.956362] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.956558] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.956680] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.956935] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.957086] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.957231] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162 not found, creating... [ 852.957493] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.957635] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.957747] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.957957] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.958104] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.958401] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.958513] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.958622] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.958822] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.958951] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.959095] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162 is going to be created. [ 852.965446] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 in Status: UNINITIALIZED for 2s [ 852.970535] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.983090] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.983310] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.983460] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.986056] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.986056] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.986056] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.076703] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8a2c08f-37db-462e-93af-a59e2eaaf2c1 req-929902ff-122e-4d90-af7e-905b6f2c083f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 853.076885] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8a2c08f-37db-462e-93af-a59e2eaaf2c1 req-929902ff-122e-4d90-af7e-905b6f2c083f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGHEST for action security_group_members [ 853.077468] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 853.077605] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGHEST for action security_group_members [ 853.079249] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.079249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.079249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.079249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.079249] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.079249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.079249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.079249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.079249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.079249] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.081121] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-99327ed1-6c09-451a-b316-eb0268988db2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.081281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.081345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.081531] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.081716] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.081821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.081876] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.082074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.082164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.082315] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.136630] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8a2c08f-37db-462e-93af-a59e2eaaf2c1 req-929902ff-122e-4d90-af7e-905b6f2c083f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGHEST for action security_group_rules [ 853.136848] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8a2c08f-37db-462e-93af-a59e2eaaf2c1 req-929902ff-122e-4d90-af7e-905b6f2c083f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGHEST for action security_group_members [ 853.137045] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8a2c08f-37db-462e-93af-a59e2eaaf2c1 req-929902ff-122e-4d90-af7e-905b6f2c083f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_rules [ 853.137195] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8a2c08f-37db-462e-93af-a59e2eaaf2c1 req-929902ff-122e-4d90-af7e-905b6f2c083f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 853.137359] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8a2c08f-37db-462e-93af-a59e2eaaf2c1 req-929902ff-122e-4d90-af7e-905b6f2c083f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 5861b0ae-ce51-4385-a142-8147432f5cc4 with Priority: HIGHEST for action port [ 853.138024] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGHEST for action security_group_rules [ 853.138172] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_rules [ 853.138298] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5861b0ae-ce51-4385-a142-8147432f5cc4 with Priority: HIGHEST for action port [ 853.138409] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGHEST for action security_group_members [ 853.138502] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 853.138839] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99327ed1-6c09-451a-b316-eb0268988db2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.138993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.139320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.139427] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.139581] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.140713] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.140867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.141083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.141248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.141357] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.142460] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-5861b0ae-ce51-4385-a142-8147432f5cc4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.142650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.142733] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.143037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.143190] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5861b0ae-ce51-4385-a142-8147432f5cc4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.144737] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-99327ed1-6c09-451a-b316-eb0268988db2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.144815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.146059] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.146059] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.297234] env[65359]: INFO networking_nsxv3.common.synchronization [None req-1e08a82d-d354-4ca3-9b9b-7c4df4f76f51 tempest-ServerActionsTestOtherB-968321773 tempest-ServerActionsTestOtherB-968321773-project-member] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_rules [ 853.297234] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_rules [ 853.297234] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.297234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.346685] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.346685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.346685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.346685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.346685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.346685] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 already deleted. [ 853.346685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.346685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.346685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.346685] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.472844] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.583709] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.587511] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.647127] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5861b0ae-ce51-4385-a142-8147432f5cc4 with status ACTIVE [ 853.647127] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.647127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.647127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.647127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.647127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.647127] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.647127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.647127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.647127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.647854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.647854] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.647854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.647854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.647854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.647854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.647854] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5861b0ae-ce51-4385-a142-8147432f5cc4 is going to be updated. [ 853.649138] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.649241] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.649527] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-99327ed1-6c09-451a-b316-eb0268988db2 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.649969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.680777] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.681042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.681160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.681333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.681539] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.681700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.726148] env[65359]: INFO networking_nsxv3.common.synchronization [req-b7c1e5ee-282b-4161-b10a-c47531d42b1d req-9dcdf1ab-4b71-4a00-9a9f-3e5f0da26279 service nova] Enqueued Resource ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d with Priority: HIGHEST for action security_group_rules [ 853.726148] env[65359]: INFO networking_nsxv3.common.synchronization [req-b7c1e5ee-282b-4161-b10a-c47531d42b1d req-9dcdf1ab-4b71-4a00-9a9f-3e5f0da26279 service nova] Enqueued Resource ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d with Priority: HIGHEST for action security_group_members [ 853.726148] env[65359]: INFO networking_nsxv3.common.synchronization [req-b7c1e5ee-282b-4161-b10a-c47531d42b1d req-9dcdf1ab-4b71-4a00-9a9f-3e5f0da26279 service nova] Enqueued Resource ID: ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162 with Priority: HIGHEST for action port [ 853.726148] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d with Priority: HIGHEST for action security_group_rules [ 853.726148] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d with Priority: HIGHEST for action security_group_members [ 853.726148] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162 with Priority: HIGHEST for action port [ 853.726148] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.726148] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.726148] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.727415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.727655] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.729968] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.730920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.730920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.733022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.733022] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.733022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.733022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.733022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.733022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.733022] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.736594] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.736594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.736594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.736594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.736594] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.870215] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.870215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.870215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.870215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.870215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.870215] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 already deleted. [ 853.870215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.979673] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.979839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.980248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.980575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.980730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.980899] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4a73e88-8afb-4866-a66b-2583f493db5e is going to be updated. [ 854.011051] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.011298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.011298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.011420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.011634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.020742] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4a73e88-8afb-4866-a66b-2583f493db5e in Status: IN_PROGRESS for 2s [ 854.087139] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.088145] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.236857] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.237152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.237266] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.238249] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162 with status ACTIVE [ 854.238396] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.238515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.238592] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.238804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.238894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.239135] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.239188] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.239260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.239415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.239492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.239679] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.239772] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.239831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.240052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.240109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.240197] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162 is going to be updated. [ 854.264963] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.265155] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.265251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.265467] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.265607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.265782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffd8ee2f-4745-4ac6-bbb6-daa98c6c2162" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.590891] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.590891] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.591314] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.591314] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.591314] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.591462] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 854.593337] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.593570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.593570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.593729] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.594309] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.594309] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99327ed1-6c09-451a-b316-eb0268988db2 is going to be created. [ 854.632522] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.632766] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.636377] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.636580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.636768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.642063] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.642063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.642063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.642063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.642466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.656040] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 854.656842] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99327ed1-6c09-451a-b316-eb0268988db2 in Status: UNINITIALIZED for 2s [ 854.686741] env[65359]: INFO networking_nsxv3.common.synchronization [req-2fc89a1a-6350-4ae1-a3c8-5f2fc213ae70 req-adf96d46-f4ac-47b0-adb4-6057d7372094 tempest-ImagesOneServerNegativeTestJSON-1491004073 tempest-ImagesOneServerNegativeTestJSON-1491004073-project-member] Enqueued Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 854.687606] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 854.688073] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.688233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.688382] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.688757] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.688884] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.689073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.689146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.689342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.689493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.689626] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.744618] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.973895] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 in Status: SUCCESS [ 854.976120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.976120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.976120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.976120] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.976120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.976120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.976120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.976120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.976120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.976120] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3711d124-9bf8-4fa4-9c53-ee6c21e9b344',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.106692] env[65359]: INFO networking_nsxv3.common.synchronization [req-aec92183-0ad1-4870-bf8f-de598608e9ea req-1839542b-0211-4f28-8690-8ce5b5a6bf24 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGHEST for action security_group_members [ 855.107263] env[65359]: INFO networking_nsxv3.common.synchronization [req-aec92183-0ad1-4870-bf8f-de598608e9ea req-1839542b-0211-4f28-8690-8ce5b5a6bf24 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: daa8b334-470d-4702-9560-94a964a51d78 with Priority: HIGHEST for action security_group_members [ 855.107263] env[65359]: INFO networking_nsxv3.common.synchronization [req-aec92183-0ad1-4870-bf8f-de598608e9ea req-1839542b-0211-4f28-8690-8ce5b5a6bf24 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 855.108159] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGHEST for action security_group_members [ 855.108369] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daa8b334-470d-4702-9560-94a964a51d78 with Priority: HIGHEST for action security_group_members [ 855.108566] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 855.111612] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-99327ed1-6c09-451a-b316-eb0268988db2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.111612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.111612] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-daa8b334-470d-4702-9560-94a964a51d78 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.111612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.111612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.111612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.111612] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.111612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.111612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.111612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.111612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.111612] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daa8b334-470d-4702-9560-94a964a51d78',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.112321] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.112321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.156147] env[65359]: INFO networking_nsxv3.common.synchronization [req-aec92183-0ad1-4870-bf8f-de598608e9ea req-1839542b-0211-4f28-8690-8ce5b5a6bf24 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGHEST for action security_group_rules [ 855.156332] env[65359]: INFO networking_nsxv3.common.synchronization [req-aec92183-0ad1-4870-bf8f-de598608e9ea req-1839542b-0211-4f28-8690-8ce5b5a6bf24 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGHEST for action security_group_members [ 855.156466] env[65359]: INFO networking_nsxv3.common.synchronization [req-aec92183-0ad1-4870-bf8f-de598608e9ea req-1839542b-0211-4f28-8690-8ce5b5a6bf24 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_rules [ 855.156605] env[65359]: INFO networking_nsxv3.common.synchronization [req-aec92183-0ad1-4870-bf8f-de598608e9ea req-1839542b-0211-4f28-8690-8ce5b5a6bf24 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 855.156733] env[65359]: INFO networking_nsxv3.common.synchronization [req-aec92183-0ad1-4870-bf8f-de598608e9ea req-1839542b-0211-4f28-8690-8ce5b5a6bf24 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: daa8b334-470d-4702-9560-94a964a51d78 with Priority: HIGHEST for action security_group_rules [ 855.156940] env[65359]: INFO networking_nsxv3.common.synchronization [req-aec92183-0ad1-4870-bf8f-de598608e9ea req-1839542b-0211-4f28-8690-8ce5b5a6bf24 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: daa8b334-470d-4702-9560-94a964a51d78 with Priority: HIGHEST for action security_group_members [ 855.157105] env[65359]: INFO networking_nsxv3.common.synchronization [req-aec92183-0ad1-4870-bf8f-de598608e9ea req-1839542b-0211-4f28-8690-8ce5b5a6bf24 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 5861b0ae-ce51-4385-a142-8147432f5cc4 with Priority: HIGHEST for action port [ 855.157620] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGHEST for action security_group_rules [ 855.157714] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_rules [ 855.157812] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daa8b334-470d-4702-9560-94a964a51d78 with Priority: HIGHEST for action security_group_members [ 855.157905] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5861b0ae-ce51-4385-a142-8147432f5cc4 with Priority: HIGHEST for action port [ 855.157994] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daa8b334-470d-4702-9560-94a964a51d78 with Priority: HIGHEST for action security_group_rules [ 855.158148] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGHEST for action security_group_members [ 855.158246] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 855.158556] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99327ed1-6c09-451a-b316-eb0268988db2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.158659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.158859] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.158939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.159124] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-daa8b334-470d-4702-9560-94a964a51d78 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.159271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.159460] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-5861b0ae-ce51-4385-a142-8147432f5cc4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.159558] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.159623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.160234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.160322] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5861b0ae-ce51-4385-a142-8147432f5cc4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.162595] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daa8b334-470d-4702-9560-94a964a51d78 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.162704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.162754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.162966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.163065] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daa8b334-470d-4702-9560-94a964a51d78',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.163842] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-99327ed1-6c09-451a-b316-eb0268988db2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.163937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.166018] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.166018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.192671] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.192865] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-196" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.192983] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-196" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.193255] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-196" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.193506] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.193691] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.193805] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.194050] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.194163] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.194366] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.194478] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.194580] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.194679] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.194805] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.194882] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.195020] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.196940] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.197059] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.197136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.197278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.218039] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.218228] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 855.218360] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.218554] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-196" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.219168] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-486132b1-1032-4de8-a29d-9533fc53c5ae taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.219168] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-486132b1-1032-4de8-a29d-9533fc53c5ae" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.219168] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-486132b1-1032-4de8-a29d-9533fc53c5ae" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.219446] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-486132b1-1032-4de8-a29d-9533fc53c5ae" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.219654] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('486132b1-1032-4de8-a29d-9533fc53c5ae',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.222637] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.223281] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.223281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.223281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.223281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.223487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.223487] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 is going to be updated. [ 855.246813] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.247029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.247122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.247374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.247500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.247597] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d is going to be created. [ 855.251861] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.252098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.252182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.252857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.252857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.264015] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: IN_PROGRESS for 2s [ 855.274955] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.274955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.275145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.275272] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.275439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.286655] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d in Status: UNINITIALIZED for 2s [ 855.478922] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3711d124-9bf8-4fa4-9c53-ee6c21e9b344',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.614733] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daa8b334-470d-4702-9560-94a964a51d78',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.665740] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5861b0ae-ce51-4385-a142-8147432f5cc4 with status ACTIVE [ 855.666722] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.666942] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.667030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.667261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.667356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.667555] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.667657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.667721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.667871] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.667947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.668149] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.668248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.668310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.668451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.668523] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.668606] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5861b0ae-ce51-4385-a142-8147432f5cc4 is going to be updated. [ 855.669823] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-daa8b334-470d-4702-9560-94a964a51d78 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.669963] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.706162] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.706950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.706950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.706950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.706950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.706950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5861b0ae-ce51-4385-a142-8147432f5cc4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.722409] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.722704] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.722784] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.723114] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.723271] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.723500] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 486132b1-1032-4de8-a29d-9533fc53c5ae not found, creating... [ 855.723811] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.723996] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.724135] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.724455] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.724535] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.724826] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.724982] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.725109] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.725326] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.725458] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.725595] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 486132b1-1032-4de8-a29d-9533fc53c5ae is going to be created. [ 855.750782] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.751018] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.751140] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.751422] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.751650] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.751879] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-486132b1-1032-4de8-a29d-9533fc53c5ae" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.980599] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3711d124-9bf8-4fa4-9c53-ee6c21e9b344: rpc.has_security_group_logging(os_id): False [ 856.001177] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.001339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.001419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.001688] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.001787] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.002194] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.002312] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.002377] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.002522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.002589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.002677] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 is going to be created. [ 856.032979] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4a73e88-8afb-4866-a66b-2583f493db5e in Status: SUCCESS [ 856.033236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.033418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.033632] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.034028] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.034429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.034429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.034597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.034597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.034679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.035311] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.035464] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.035532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.035697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.035853] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.035954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.036034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.036183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.036263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.036348] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.036441] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.108880] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.108880] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.108880] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.109169] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.109205] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.116762] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daa8b334-470d-4702-9560-94a964a51d78',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.134401] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 in Status: IN_PROGRESS for 2s [ 856.533708] env[65359]: INFO networking_nsxv3.common.synchronization [req-2fc89a1a-6350-4ae1-a3c8-5f2fc213ae70 req-970076cd-d9ff-4b79-973d-b7e503605e7f service nova] Enqueued Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_rules [ 856.533889] env[65359]: INFO networking_nsxv3.common.synchronization [req-2fc89a1a-6350-4ae1-a3c8-5f2fc213ae70 req-970076cd-d9ff-4b79-973d-b7e503605e7f service nova] Enqueued Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 856.534032] env[65359]: INFO networking_nsxv3.common.synchronization [req-2fc89a1a-6350-4ae1-a3c8-5f2fc213ae70 req-970076cd-d9ff-4b79-973d-b7e503605e7f service nova] Enqueued Resource ID: 486132b1-1032-4de8-a29d-9533fc53c5ae with Priority: HIGHEST for action port [ 856.534624] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_rules [ 856.534711] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 856.534806] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 486132b1-1032-4de8-a29d-9533fc53c5ae with Priority: HIGHEST for action port [ 856.535098] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.535230] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.535296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.535505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.535587] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.536481] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.536569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.536767] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-486132b1-1032-4de8-a29d-9533fc53c5ae taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.536866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-486132b1-1032-4de8-a29d-9533fc53c5ae" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.536931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-486132b1-1032-4de8-a29d-9533fc53c5ae" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.537131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-486132b1-1032-4de8-a29d-9533fc53c5ae" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.537212] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('486132b1-1032-4de8-a29d-9533fc53c5ae',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.540646] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4a73e88-8afb-4866-a66b-2583f493db5e: rpc.has_security_group_logging(os_id): False [ 856.559271] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.559417] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.559533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.559695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.559783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.559966] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.560080] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.560146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.560298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.560376] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.560577] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.560674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.560740] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.560880] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.560955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.561157] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.561254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.561317] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.561456] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.561529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.561705] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4a73e88-8afb-4866-a66b-2583f493db5e is going to be created. [ 856.620060] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.620365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.620365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.620527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.620621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.620745] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daa8b334-470d-4702-9560-94a964a51d78 is going to be created. [ 856.628205] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.628417] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.628417] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.628627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.628816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.642944] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4a73e88-8afb-4866-a66b-2583f493db5e in Status: IN_PROGRESS for 2s [ 856.652465] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.652749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.652749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.652926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.653091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.666772] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daa8b334-470d-4702-9560-94a964a51d78 in Status: UNINITIALIZED for 2s [ 856.667959] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99327ed1-6c09-451a-b316-eb0268988db2 in Status: SUCCESS [ 856.668177] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.668814] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 856.668981] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.669366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.669455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.669653] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.669836] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.669953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.670235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.670369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.670528] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.671445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.671650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.671791] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.671901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.671962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.672507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.672507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.672789] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.041506] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.041643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.041832] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 486132b1-1032-4de8-a29d-9533fc53c5ae with status ACTIVE [ 857.041997] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.042152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.042221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.042437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.042525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.042699] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.046031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.046031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.046031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.046031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.046031] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.046031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.046031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.046031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.046031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.046031] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 486132b1-1032-4de8-a29d-9533fc53c5ae is going to be updated. [ 857.078068] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.078923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.079040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.080365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.081056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.081056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-486132b1-1032-4de8-a29d-9533fc53c5ae" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.175160] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.176931] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.276341] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: SUCCESS [ 857.276574] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 deletion is rescheduled due to dependency. [ 857.276700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.276958] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.277254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.277460] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.277587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.277870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.277870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.277953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.278076] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.296064] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d in Status: SUCCESS [ 857.296297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.297138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.297138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.297220] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.297319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.297389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.297821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.297821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.297821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.297821] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.432110] env[65359]: INFO networking_nsxv3.common.synchronization [req-b1753e14-4260-400b-8bff-4af4aa46a357 req-f97bfe1b-2a2c-452b-b5af-fe54021f5379 tempest-ImagesTestJSON-1497561183 tempest-ImagesTestJSON-1497561183-project-member] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 857.432860] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 857.433274] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.433500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.433614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.433789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.433967] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.434153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.434153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.434511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.434511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.434511] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.677990] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.679823] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.780466] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.802758] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.854233] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-189 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.854233] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.854385] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.854667] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.854929] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.855276] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.855419] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.855642] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.855785] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.855995] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.856118] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.856249] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.856873] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.856873] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.856873] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.856873] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.881871] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.882136] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 857.882373] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.882561] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.882874] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-e7b16917-22bb-4a65-be21-0be43fdde0f1 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.883112] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-e7b16917-22bb-4a65-be21-0be43fdde0f1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.883246] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-e7b16917-22bb-4a65-be21-0be43fdde0f1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.883564] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-e7b16917-22bb-4a65-be21-0be43fdde0f1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.883705] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7b16917-22bb-4a65-be21-0be43fdde0f1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.938498] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.938796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.938927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.939209] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.960333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.960589] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.960763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.960818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.960974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.961149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.961149] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 857.989605] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.989818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.989818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.990121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.990275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.999212] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 858.145888] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 in Status: SUCCESS [ 858.146126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.180919] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.181187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.181187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.181461] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.181582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.181689] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99327ed1-6c09-451a-b316-eb0268988db2 is going to be updated. [ 858.184756] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.184973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.184973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.185193] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.185288] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.185400] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 858.215325] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.215530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.215597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.215868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.216084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.218122] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.218281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.218363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.218590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.218751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.230951] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 858.231884] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99327ed1-6c09-451a-b316-eb0268988db2 in Status: IN_PROGRESS for 2s [ 858.283118] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.304353] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d: rpc.has_security_group_logging(os_id): False [ 858.324045] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.324045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.324045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.324045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.324045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.324045] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.324045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.324045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.324990] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.324990] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.324990] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d is going to be created. [ 858.385763] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.386081] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.386208] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.386504] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.386665] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.386823] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port e7b16917-22bb-4a65-be21-0be43fdde0f1 not found, creating... [ 858.387116] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.387309] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.387389] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.387671] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.387843] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.388151] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.388309] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.388422] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.388637] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.388877] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.388914] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: e7b16917-22bb-4a65-be21-0be43fdde0f1 is going to be created. [ 858.405192] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.405192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.405192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.405192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.405192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.414666] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.415112] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.415428] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.415796] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.416138] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.416496] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-e7b16917-22bb-4a65-be21-0be43fdde0f1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.441580] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d in Status: IN_PROGRESS for 2s [ 858.655803] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4a73e88-8afb-4866-a66b-2583f493db5e in Status: SUCCESS [ 858.656036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.656199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.656423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.656514] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.678515] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daa8b334-470d-4702-9560-94a964a51d78 in Status: SUCCESS [ 858.678891] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.678964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.679287] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.679505] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.679633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.679779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.679946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.680041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.680153] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daa8b334-470d-4702-9560-94a964a51d78',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.785251] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.785425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.785425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.785773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.785945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.786147] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 is going to be updated. [ 858.852497] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.852643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.852710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.852881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.853077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.864709] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: IN_PROGRESS for 2s [ 859.114374] env[65359]: INFO networking_nsxv3.common.synchronization [req-b1753e14-4260-400b-8bff-4af4aa46a357 req-106dbc16-b7c2-49a9-ae29-a13b1c470c1b service nova] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_rules [ 859.114649] env[65359]: INFO networking_nsxv3.common.synchronization [req-b1753e14-4260-400b-8bff-4af4aa46a357 req-106dbc16-b7c2-49a9-ae29-a13b1c470c1b service nova] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 859.114649] env[65359]: INFO networking_nsxv3.common.synchronization [req-b1753e14-4260-400b-8bff-4af4aa46a357 req-106dbc16-b7c2-49a9-ae29-a13b1c470c1b service nova] Enqueued Resource ID: e7b16917-22bb-4a65-be21-0be43fdde0f1 with Priority: HIGHEST for action port [ 859.115182] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_rules [ 859.115320] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 859.115418] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b16917-22bb-4a65-be21-0be43fdde0f1 with Priority: HIGHEST for action port [ 859.115698] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.115818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.115888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.117265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.117265] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.117265] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.117265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.117827] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7b16917-22bb-4a65-be21-0be43fdde0f1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.117827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7b16917-22bb-4a65-be21-0be43fdde0f1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.117827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7b16917-22bb-4a65-be21-0be43fdde0f1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.117827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7b16917-22bb-4a65-be21-0be43fdde0f1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.119816] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7b16917-22bb-4a65-be21-0be43fdde0f1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.159495] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.159657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.159712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.159967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.160098] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.160219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.160296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.160418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.160499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.160592] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.160679] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.183700] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daa8b334-470d-4702-9560-94a964a51d78',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.621940] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.622185] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.622313] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7b16917-22bb-4a65-be21-0be43fdde0f1 with status ACTIVE [ 859.622770] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.622770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.622770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.623260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.623260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.623260] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.623260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.624854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.626856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.626856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.626856] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.627146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.627146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.627222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.627258] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.629054] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7b16917-22bb-4a65-be21-0be43fdde0f1 is going to be updated. [ 859.651418] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.651418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.651418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.651418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.651418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.651707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7b16917-22bb-4a65-be21-0be43fdde0f1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.663337] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.664051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.664051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.664051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.664051] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.664051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.664768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.664768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.664768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.664768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.664768] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.664768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.664768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.665294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.665294] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.665294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.665294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.665294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.665525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.665525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.665525] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.684268] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daa8b334-470d-4702-9560-94a964a51d78',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.011914] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 860.012166] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 deletion is rescheduled due to dependency. [ 860.012313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.012527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.012814] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.013023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.013148] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.013216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.013893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.013893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.013893] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.168249] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4a73e88-8afb-4866-a66b-2583f493db5e: rpc.has_security_group_logging(os_id): False [ 860.188330] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.188330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.188330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.188330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.188330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.188526] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daa8b334-470d-4702-9560-94a964a51d78 is going to be updated. [ 860.192578] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.192578] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.192692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.192862] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.192983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.193913] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.193913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.193913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.193913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.193913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.194154] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.194154] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.194154] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.194278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.194370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.195910] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.195910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.195910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.195910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.195910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.195910] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4a73e88-8afb-4866-a66b-2583f493db5e is going to be updated. [ 860.231164] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.231374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.231457] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.232079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.232327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.247074] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99327ed1-6c09-451a-b316-eb0268988db2 in Status: SUCCESS [ 860.247403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.248113] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.248113] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.248113] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.248725] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.248725] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.248725] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.248725] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.249631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.249631] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.251590] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daa8b334-470d-4702-9560-94a964a51d78 in Status: IN_PROGRESS for 2s [ 860.252546] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 860.252847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.253266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.254922] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.254922] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.254922] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.254922] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.254922] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.254922] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.254922] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.257403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.257403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.257403] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.257403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.257403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.257403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.257403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.257403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.257403] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.258952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.258952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.258952] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.259554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.259554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.259554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.259554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.259554] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.269494] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.269647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.269721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.269978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.270116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.294391] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4a73e88-8afb-4866-a66b-2583f493db5e in Status: IN_PROGRESS for 2s [ 860.455500] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d in Status: SUCCESS [ 860.455794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.522270] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.761427] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.762499] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.763953] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.763953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.763953] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.882342] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: SUCCESS [ 860.883187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.883187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.883187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.883187] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.883538] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.883538] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.883538] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.883774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.883774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.883950] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.022614] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.265562] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99327ed1-6c09-451a-b316-eb0268988db2: rpc.has_security_group_logging(os_id): False [ 861.269583] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.270913] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.292140] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.292325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.292377] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.292593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.292697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.292934] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.293062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.293131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.293316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.293710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.293710] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99327ed1-6c09-451a-b316-eb0268988db2 is going to be created. [ 861.364369] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.364695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.364695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.365018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.368173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.382297] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99327ed1-6c09-451a-b316-eb0268988db2 in Status: IN_PROGRESS for 2s [ 861.389298] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.389460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.389585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.389770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.389961] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.390115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.390196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.390381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.390473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.390569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.390740] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.390842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.390918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.391092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.392375] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.392375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.392375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.392375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.392375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.392375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.392375] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.526637] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.526822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.527163] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.527635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.527755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.527877] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 861.561975] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.562217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.562289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.563244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.563462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.574166] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 861.774261] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.774722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.774722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.774722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.774933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.774999] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99327ed1-6c09-451a-b316-eb0268988db2 is going to be updated. [ 861.776578] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.776804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.776804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.776945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.779161] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.779357] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 861.838027] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.838027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.838027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.838027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.838027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.838844] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.839127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.839352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.839633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.839898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.858178] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99327ed1-6c09-451a-b316-eb0268988db2 in Status: IN_PROGRESS for 2s [ 861.858178] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 861.894877] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f713e30a-d102-48fb-9e09-3c3ec7abbc99: rpc.has_security_group_logging(os_id): False [ 861.918383] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.918631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.918631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.918832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.919018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.919255] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.919381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.919460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.921031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.921031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.921031] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.921031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.921031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.921031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.921031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.921031] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.921031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.921031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.921793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.921793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.921793] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 is going to be updated. [ 862.056219] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.056546] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.056716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.056860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.057068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.078952] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: IN_PROGRESS for 2s [ 862.264785] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daa8b334-470d-4702-9560-94a964a51d78 in Status: SUCCESS [ 862.266031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.266031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.266031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.266031] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.266327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.266975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.267281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.267597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.267775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.267901] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('daa8b334-470d-4702-9560-94a964a51d78',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.308986] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4a73e88-8afb-4866-a66b-2583f493db5e in Status: SUCCESS [ 862.309291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.771588] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('daa8b334-470d-4702-9560-94a964a51d78',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.274819] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for daa8b334-470d-4702-9560-94a964a51d78: rpc.has_security_group_logging(os_id): False [ 863.296655] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.296927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.297080] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.298074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.298074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.298074] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.298074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.298074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.298074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.298301] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.298301] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daa8b334-470d-4702-9560-94a964a51d78 is going to be created. [ 863.358211] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.358851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.358851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.358973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.359265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.372575] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daa8b334-470d-4702-9560-94a964a51d78 in Status: IN_PROGRESS for 2s [ 863.402045] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99327ed1-6c09-451a-b316-eb0268988db2 in Status: SUCCESS [ 863.402450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.402906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.403249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.403389] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.585408] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 863.585657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.585864] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.586227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.586345] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.586452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.586452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.586620] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.586697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.586813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.586964] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.872031] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99327ed1-6c09-451a-b316-eb0268988db2 in Status: SUCCESS [ 863.872031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.872031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.872031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.872031] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.872031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.872031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.872031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.872031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.872031] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.876322] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 863.876768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.882915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.882915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.882915] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.882915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.882915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.882915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.882915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.882915] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.907570] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-99327ed1-6c09-451a-b316-eb0268988db2 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.907570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.957105] env[65359]: INFO networking_nsxv3.common.synchronization [req-1fc14bb9-b63a-4085-868c-6de1bafb2b13 req-f8f2a480-93a4-4fa3-b979-2674206426d3 tempest-ServerRescueTestJSONUnderV235-1107401674 tempest-ServerRescueTestJSONUnderV235-1107401674-project-member] Enqueued Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_members [ 863.957249] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_members [ 863.957659] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.957853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.957853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.959243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.959439] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.959827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.959911] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.960104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.960178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.960287] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.092519] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.092519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.092519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.092519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.092519] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.092519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.092519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.092519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.092519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.092519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.093495] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.094644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.094644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.094644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.094644] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.094644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.094644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.094644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.094644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.095231] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.098026] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.098026] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: SUCCESS [ 864.098026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.380288] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.381833] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.463969] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.464202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.464321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.464709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.464817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.465253] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.465253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.465465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.466144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.466144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.466144] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 already deleted. [ 864.466144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.600024] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28737c44-388f-4cb8-9cac-0181cbb28981: rpc.has_security_group_logging(os_id): False [ 864.625033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.625033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.625033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.625033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.625033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.625033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.625033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.625033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.625033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.625033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.625033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.625033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.625033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.625033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.625033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.625989] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.625989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.625989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.625989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.625989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.625989] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 864.717861] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.718076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.718151] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.718371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.718524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.736730] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 864.885753] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.885753] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.895475] env[65359]: INFO networking_nsxv3.common.synchronization [req-8b7504b1-34b3-45d4-bae5-dcb31e78a56e req-23e7e7bc-6056-4f10-8e77-91d3ee608d79 tempest-ServersAdminTestJSON-387763736 tempest-ServersAdminTestJSON-387763736-project-member] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 864.896700] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 864.898465] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.898465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.898465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.898465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.898810] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.898810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.898810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.899027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.899027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.899141] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.934518] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.934715] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-410" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.934857] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-410" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.935208] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-410" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.935505] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.935667] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.935781] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.935998] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.936271] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.936525] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.936667] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.936732] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.936895] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.937110] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.937110] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.937237] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.957757] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.957955] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 864.958083] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.958271] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-410" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.958651] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-1528d181-0dbe-443b-b3f6-3441f18183e9 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.958845] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.958982] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.959361] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.959515] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1528d181-0dbe-443b-b3f6-3441f18183e9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.105163] env[65359]: INFO networking_nsxv3.common.synchronization [req-a4588eaf-5962-4926-8451-4597ccbdb84d req-f33c266b-7942-4a2a-b29f-270acc44fb90 tempest-ListImageFiltersTestJSON-1057169836 tempest-ListImageFiltersTestJSON-1057169836-project-member] Enqueued Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_members [ 865.105792] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGHEST for action security_group_members [ 865.106152] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.106280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.106354] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.106572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.106739] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.106908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.106908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.107107] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.107195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.107436] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.389043] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daa8b334-470d-4702-9560-94a964a51d78 in Status: SUCCESS [ 865.389415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.390170] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.390170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.390170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.390170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.390170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.390557] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 865.391891] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.391891] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.391891] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.392088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.392229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.392327] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99327ed1-6c09-451a-b316-eb0268988db2 is going to be updated. [ 865.401427] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.427607] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.427607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.427607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.427839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.428058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.430282] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.430433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.430929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.431376] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.431567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.445477] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99327ed1-6c09-451a-b316-eb0268988db2 in Status: IN_PROGRESS for 2s [ 865.449192] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 865.462977] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.463275] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.463427] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.463716] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.463865] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.464035] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 1528d181-0dbe-443b-b3f6-3441f18183e9 not found, creating... [ 865.464314] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.464471] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.464587] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.464810] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.464948] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.465251] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.465407] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.465524] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.465730] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.465862] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.465999] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 1528d181-0dbe-443b-b3f6-3441f18183e9 is going to be created. [ 865.502453] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.502796] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.502967] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.503278] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.503503] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.503730] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.612025] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.612025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.612025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.612025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.612025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.612025] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.612025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.612025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.612025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.612025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.612025] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655ee501-2055-483e-a130-4cf497421bd3 is going to be updated. [ 865.655071] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.655353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.655353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.655677] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.655677] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.665903] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: IN_PROGRESS for 2s [ 865.907026] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.289062] env[65359]: INFO networking_nsxv3.common.synchronization [req-1fc14bb9-b63a-4085-868c-6de1bafb2b13 req-80cfaf21-0c2d-4340-8bf4-3d1cdd990901 service nova] Enqueued Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_rules [ 866.289220] env[65359]: INFO networking_nsxv3.common.synchronization [req-1fc14bb9-b63a-4085-868c-6de1bafb2b13 req-80cfaf21-0c2d-4340-8bf4-3d1cdd990901 service nova] Enqueued Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_members [ 866.289350] env[65359]: INFO networking_nsxv3.common.synchronization [req-1fc14bb9-b63a-4085-868c-6de1bafb2b13 req-80cfaf21-0c2d-4340-8bf4-3d1cdd990901 service nova] Enqueued Resource ID: 1528d181-0dbe-443b-b3f6-3441f18183e9 with Priority: HIGHEST for action port [ 866.289618] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_rules [ 866.289756] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_members [ 866.289872] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1528d181-0dbe-443b-b3f6-3441f18183e9 with Priority: HIGHEST for action port [ 866.290681] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.290885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.290885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.291586] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.291708] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.294033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.294033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.294033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.294033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.294033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.294033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.294033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.294033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.294033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.294658] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.294854] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-1528d181-0dbe-443b-b3f6-3441f18183e9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.295018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.295018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.295573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.295573] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1528d181-0dbe-443b-b3f6-3441f18183e9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.407089] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.407482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.407482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.407639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.407639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.407880] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be updated. [ 866.439703] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.439974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.439974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.440257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.440434] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.450591] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 866.761622] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 866.761622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.798651] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.798651] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.798651] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.799493] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1528d181-0dbe-443b-b3f6-3441f18183e9 with status ACTIVE [ 866.799493] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.799885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.800100] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.801020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.801020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.801020] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.801020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.801020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.801020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.804685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.804685] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.804685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.804685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.804685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.804685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.804685] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1528d181-0dbe-443b-b3f6-3441f18183e9 is going to be updated. [ 866.847337] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.847337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.847337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.847337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.847337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.847337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.306461] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.474357] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 867.474357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.474676] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.475418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.475418] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.475418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.475418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.475668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.475668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.475757] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.476183] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.477058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.477794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.477794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.477794] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.477969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.478196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.478494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.478686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.478986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.478986] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.480734] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99327ed1-6c09-451a-b316-eb0268988db2 in Status: SUCCESS [ 867.481073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.481498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.482010] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.482310] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.482501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.482615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.482824] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.483049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.483236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.483387] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.677135] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 655ee501-2055-483e-a130-4cf497421bd3 in Status: SUCCESS [ 867.677325] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 655ee501-2055-483e-a130-4cf497421bd3 deletion is rescheduled due to dependency. [ 867.677553] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.809651] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.809814] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.809887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.810143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.810236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.810336] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 is going to be created. [ 867.835538] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.835743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.835743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.835945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.836124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.849095] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: UNINITIALIZED for 2s [ 867.985124] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6: rpc.has_security_group_logging(os_id): False [ 867.986318] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.013563] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.013563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.013730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.013903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.013965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.014214] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.014487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.014487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.014899] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.014899] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.015039] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.015039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.015120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.015527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.015527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.015527] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.015676] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.015676] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.015836] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.015901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.015992] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 868.090030] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.090030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.090030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.090030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.090030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.137348] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 868.462923] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 868.466069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.489868] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99327ed1-6c09-451a-b316-eb0268988db2: rpc.has_security_group_logging(os_id): False [ 868.501780] env[65359]: INFO networking_nsxv3.common.synchronization [req-7512845f-2d88-4a18-9bf4-89fa2269c08b req-a702e692-8a5b-4376-8609-c123d27a5927 tempest-ServerAddressesTestJSON-1604163155 tempest-ServerAddressesTestJSON-1604163155-project-member] Enqueued Resource ID: e87bd638-a489-4449-9e26-acf0926c56dc with Priority: HIGHEST for action security_group_members [ 868.501858] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e87bd638-a489-4449-9e26-acf0926c56dc with Priority: HIGHEST for action security_group_members [ 868.502246] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-e87bd638-a489-4449-9e26-acf0926c56dc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.502351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.502404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.502613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.502767] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.502864] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.502926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.506198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.506314] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.506420] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e87bd638-a489-4449-9e26-acf0926c56dc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.510323] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.510447] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.510541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.510742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.510873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.511124] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.511266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.511372] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.511534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.511658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.511707] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99327ed1-6c09-451a-b316-eb0268988db2 is going to be updated. [ 868.581460] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.581750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.581851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.582257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.582433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.599240] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99327ed1-6c09-451a-b316-eb0268988db2 in Status: IN_PROGRESS for 2s [ 868.995262] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.995262] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-37" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.995407] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-37" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.995904] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-37" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.996046] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.996320] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.996575] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.997692] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.997692] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.997692] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 868.997692] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.997692] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.997692] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.997953] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 868.997953] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.998040] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.010033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.010304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.010435] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.010646] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.010739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.010969] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.011074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.011160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.011512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.011623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.011734] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e87bd638-a489-4449-9e26-acf0926c56dc already deleted. [ 869.011837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.017794] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.017960] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 869.018112] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.018278] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-37" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.018589] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-ef1e5f59-a2de-4ffc-9f21-f014d8cb8516 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.018762] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-ef1e5f59-a2de-4ffc-9f21-f014d8cb8516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.018869] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-ef1e5f59-a2de-4ffc-9f21-f014d8cb8516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.019276] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-ef1e5f59-a2de-4ffc-9f21-f014d8cb8516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.019373] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef1e5f59-a2de-4ffc-9f21-f014d8cb8516',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.522603] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.522882] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.524080] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.524080] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.524080] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.524080] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port ef1e5f59-a2de-4ffc-9f21-f014d8cb8516 not found, creating... [ 869.524080] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.524080] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.524328] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.524455] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.524519] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.524801] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.524974] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.525118] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.525343] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.525477] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.525636] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: ef1e5f59-a2de-4ffc-9f21-f014d8cb8516 is going to be created. [ 869.550990] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.551222] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.551388] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.551688] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.551980] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.552598] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-ef1e5f59-a2de-4ffc-9f21-f014d8cb8516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.860145] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: SUCCESS [ 869.860413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.861035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.861035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.861035] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.861304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.861344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.861522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.861717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.861789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.861963] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.155192] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 870.155485] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.155998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.156264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.156361] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.367773] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.367773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.367773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.367773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.367773] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.367773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.367773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.367773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.367773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.367773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.367773] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.367773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.370664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.370664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.370664] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.370664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.370664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.370664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.370664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.370664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.370664] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.387330] env[65359]: INFO networking_nsxv3.common.synchronization [req-7512845f-2d88-4a18-9bf4-89fa2269c08b req-59b5bc65-b93b-4809-b2d2-8fc446d5bd61 service nova] Enqueued Resource ID: e87bd638-a489-4449-9e26-acf0926c56dc with Priority: HIGHEST for action security_group_rules [ 870.388688] env[65359]: INFO networking_nsxv3.common.synchronization [req-7512845f-2d88-4a18-9bf4-89fa2269c08b req-59b5bc65-b93b-4809-b2d2-8fc446d5bd61 service nova] Enqueued Resource ID: e87bd638-a489-4449-9e26-acf0926c56dc with Priority: HIGHEST for action security_group_members [ 870.388688] env[65359]: INFO networking_nsxv3.common.synchronization [req-7512845f-2d88-4a18-9bf4-89fa2269c08b req-59b5bc65-b93b-4809-b2d2-8fc446d5bd61 service nova] Enqueued Resource ID: ef1e5f59-a2de-4ffc-9f21-f014d8cb8516 with Priority: HIGHEST for action port [ 870.389431] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e87bd638-a489-4449-9e26-acf0926c56dc with Priority: HIGHEST for action security_group_rules [ 870.389627] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e87bd638-a489-4449-9e26-acf0926c56dc with Priority: HIGHEST for action security_group_members [ 870.389745] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1e5f59-a2de-4ffc-9f21-f014d8cb8516 with Priority: HIGHEST for action port [ 870.391480] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e87bd638-a489-4449-9e26-acf0926c56dc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.391726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.391726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.392320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.392320] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e87bd638-a489-4449-9e26-acf0926c56dc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.395037] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-e87bd638-a489-4449-9e26-acf0926c56dc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.395037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.395037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.395037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.395037] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.395037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.395037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.395037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.395037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.395037] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e87bd638-a489-4449-9e26-acf0926c56dc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.398399] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef1e5f59-a2de-4ffc-9f21-f014d8cb8516 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.398399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef1e5f59-a2de-4ffc-9f21-f014d8cb8516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.398399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef1e5f59-a2de-4ffc-9f21-f014d8cb8516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.398399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef1e5f59-a2de-4ffc-9f21-f014d8cb8516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.398399] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef1e5f59-a2de-4ffc-9f21-f014d8cb8516',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.614922] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99327ed1-6c09-451a-b316-eb0268988db2 in Status: SUCCESS [ 870.615280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.658978] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.659396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.659641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.661439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.661439] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.661439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.661439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.661439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.661439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.661439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.661439] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.874787] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9: rpc.has_security_group_logging(os_id): False [ 870.895162] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.895713] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.896082] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.896367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.896917] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.897215] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.897668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.897788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.898151] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.898659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.899063] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.899231] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.899338] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.899914] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.899914] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.899914] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.899914] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.900150] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.900423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.900423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.900423] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 is going to be created. [ 870.902066] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e87bd638-a489-4449-9e26-acf0926c56dc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.903032] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef1e5f59-a2de-4ffc-9f21-f014d8cb8516 with status ACTIVE [ 870.903311] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.903600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.903600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.904834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.904834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.904834] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.904834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.904834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.904834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.904834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.904834] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.904834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.904834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.905450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.905450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.905450] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef1e5f59-a2de-4ffc-9f21-f014d8cb8516 is going to be updated. [ 870.906711] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-e87bd638-a489-4449-9e26-acf0926c56dc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.906711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.933322] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.933512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.933569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.933753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.933891] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.934075] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef1e5f59-a2de-4ffc-9f21-f014d8cb8516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.979291] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.979291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.979291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.979499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.979699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.993969] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: IN_PROGRESS for 2s [ 871.165174] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.165174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.165174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.165174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.165174] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.165174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.165174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.165174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.165174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.165174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.165174] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.165174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.165174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.165174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.165174] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.165174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.166681] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.166681] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.166681] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.166681] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.166681] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.408656] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e87bd638-a489-4449-9e26-acf0926c56dc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.669227] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6: rpc.has_security_group_logging(os_id): False [ 871.688066] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.688317] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.688411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.688701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.688800] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.689018] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.689136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.689198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.689426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.689579] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.689803] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.690068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.690192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.690364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.690432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.690742] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.690848] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.690912] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.691076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.691164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.691240] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 871.855480] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.855853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.855853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.855988] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.856217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.875686] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 871.915762] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.915762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.915762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.915762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.915762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.915762] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e87bd638-a489-4449-9e26-acf0926c56dc is going to be created. [ 872.030674] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.033022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.033022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.033022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.033022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.053723] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e87bd638-a489-4449-9e26-acf0926c56dc in Status: UNINITIALIZED for 2s [ 873.006259] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: SUCCESS [ 873.006502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.890992] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 873.891307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.105875] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e87bd638-a489-4449-9e26-acf0926c56dc in Status: SUCCESS [ 874.105875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.105875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.105875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.105875] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.105875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.105875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.105875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.105875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.105875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.105875] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e87bd638-a489-4449-9e26-acf0926c56dc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.574391] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-e87bd638-a489-4449-9e26-acf0926c56dc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.574391] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.574758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.574960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.575183] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.575278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.575363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.575509] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.575611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.575773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.576203] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-e87bd638-a489-4449-9e26-acf0926c56dc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.576349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.576413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.576606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.576769] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.576903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.577034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.577215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.577316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.577399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.577496] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e87bd638-a489-4449-9e26-acf0926c56dc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.085486] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e87bd638-a489-4449-9e26-acf0926c56dc: rpc.has_security_group_logging(os_id): False [ 875.106205] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.106543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.106543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.106689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.106767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.106951] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.107061] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.107121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.107279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.107370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.107588] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.107700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.107762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.107903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.107977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.109830] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.110068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.110171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.110337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.110419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.110526] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e87bd638-a489-4449-9e26-acf0926c56dc is going to be created. [ 875.177646] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.177818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.177909] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.178129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.178311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.191657] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e87bd638-a489-4449-9e26-acf0926c56dc in Status: IN_PROGRESS for 2s [ 875.391285] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 875.391285] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 875.461196] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-124 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.461511] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.461591] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.463848] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.463848] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.463848] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.463848] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.463848] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.463848] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.463848] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.463848] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.463848] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.463848] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.464603] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.464603] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.464603] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.487672] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.487938] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 875.488180] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.488464] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.488913] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-4363feb5-a604-41f5-bfcc-d44e8fdaf970 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.489152] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.489340] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.489647] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.490909] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4363feb5-a604-41f5-bfcc-d44e8fdaf970',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.563224] env[65359]: INFO networking_nsxv3.common.synchronization [None req-dd2f49c3-b2f0-4659-a29b-7182ca51805e tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 with Priority: HIGHEST for action security_group_rules [ 875.563826] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 with Priority: HIGHEST for action security_group_rules [ 875.564345] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.564345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.564483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.564647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.564736] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bbf694f-ad41-4969-a7b8-1248ccdf3fa1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.696439] env[65359]: INFO networking_nsxv3.common.synchronization [None req-34f3c14c-a521-4e8f-8596-c694a04097a6 tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 with Priority: HIGHEST for action security_group_rules [ 875.697047] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 with Priority: HIGHEST for action security_group_rules [ 875.697700] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.697700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.993300] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.993656] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.993872] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.994327] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.994629] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.995254] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.995519] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.995713] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.996145] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.996427] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.996983] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.997288] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.997457] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.997820] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.998037] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.998278] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 4363feb5-a604-41f5-bfcc-d44e8fdaf970 is going to be updated. [ 876.027022] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.027377] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.027555] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.027847] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.028072] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.028330] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.086788] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.087029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.087159] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.087452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.087695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.087771] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 already deleted. [ 876.087876] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.088088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.088343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.088429] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bbf694f-ad41-4969-a7b8-1248ccdf3fa1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.612477] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.612861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.612861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.612925] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.612987] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.613093] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 already deleted. [ 876.613180] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.763545] env[65359]: INFO networking_nsxv3.common.synchronization [req-c5d74a20-6fe9-4681-beb1-f9a3059ce5ca req-bc282d0e-91ca-4e08-bcdf-042ba764264c service nova] Enqueued Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_rules [ 876.763904] env[65359]: INFO networking_nsxv3.common.synchronization [req-c5d74a20-6fe9-4681-beb1-f9a3059ce5ca req-bc282d0e-91ca-4e08-bcdf-042ba764264c service nova] Enqueued Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_members [ 876.764115] env[65359]: INFO networking_nsxv3.common.synchronization [req-c5d74a20-6fe9-4681-beb1-f9a3059ce5ca req-bc282d0e-91ca-4e08-bcdf-042ba764264c service nova] Enqueued Resource ID: 4363feb5-a604-41f5-bfcc-d44e8fdaf970 with Priority: HIGHEST for action port [ 876.764988] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_rules [ 876.765167] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_members [ 876.765370] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4363feb5-a604-41f5-bfcc-d44e8fdaf970 with Priority: HIGHEST for action port [ 876.768892] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.768892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.768892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.768892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.768892] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.768892] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.768892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.768892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.769137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.769635] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.769635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.769635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.769862] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.771360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.775048] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.776234] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-4363feb5-a604-41f5-bfcc-d44e8fdaf970 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.776428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.776521] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.776780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.776875] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4363feb5-a604-41f5-bfcc-d44e8fdaf970',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.146070] env[65359]: INFO networking_nsxv3.common.synchronization [req-24b4088d-3eda-4302-95aa-807baabeaca9 req-15c957da-fa4e-4265-8604-7bf5c8e358f2 tempest-MigrationsAdminTest-860872539 tempest-MigrationsAdminTest-860872539-project-member] Enqueued Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_members [ 877.147866] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_members [ 877.149974] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.150254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.150254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.150709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.150709] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.150945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.150945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.151036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.151361] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.152275] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.209985] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e87bd638-a489-4449-9e26-acf0926c56dc in Status: SUCCESS [ 877.210262] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.278985] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.281022] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.281022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.281253] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4363feb5-a604-41f5-bfcc-d44e8fdaf970 with status ACTIVE [ 877.281554] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.281723] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.281843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.282221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.282353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.282652] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.282827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.282921] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.283236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.283317] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.284033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.284033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.284033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.284286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.284286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.284387] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4363feb5-a604-41f5-bfcc-d44e8fdaf970 is going to be updated. [ 877.310519] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.311687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.311687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.311687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.311687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.311687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4363feb5-a604-41f5-bfcc-d44e8fdaf970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.655770] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.787646] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.158983] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.292466] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.294453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.294453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.294453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.294453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.294453] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 is going to be updated. [ 878.328679] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.329172] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.329172] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.329460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.329597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.343640] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 in Status: IN_PROGRESS for 2s [ 878.661580] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.661938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.661938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.662102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.662194] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.662307] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09044820-85da-426b-b103-26678a0652e6 is going to be updated. [ 878.698748] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.698974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.699106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.699389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.699573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.710618] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: IN_PROGRESS for 2s [ 880.356979] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 in Status: SUCCESS [ 880.357621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.357965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.358110] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.358336] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.358467] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.359300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.359300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.359300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.359300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.359300] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.727179] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: IN_PROGRESS for 4s [ 880.863152] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.172915] env[65359]: INFO networking_nsxv3.common.synchronization [req-2481d5c8-b13e-41cd-8ce5-2db8eb3cad3a req-775ab123-41e3-4a29-a692-d5203eb9e0bb tempest-ServerActionsTestOtherB-968321773 tempest-ServerActionsTestOtherB-968321773-project-member] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 881.172915] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 881.173701] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.173832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.173887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.174167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.174344] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.174457] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.174542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.174679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.174761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.174855] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.367832] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f94b344-4b21-4fd0-9c3a-2488e3e7e504: rpc.has_security_group_logging(os_id): False [ 881.396033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.396193] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.396255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.396986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.425327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.425647] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.425781] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.425886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.426077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.426164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.426260] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 is going to be updated. [ 881.497089] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.497327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.497386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.497596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.497735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.522704] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 in Status: IN_PROGRESS for 2s [ 881.635963] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-400 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.636252] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.636384] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.636655] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.639216] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.639852] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.640179] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.640578] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.643034] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.643034] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.643034] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.643034] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.643034] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.643034] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.643034] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.643034] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.666886] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.666886] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 881.666886] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.666886] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.666886] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-8f367f00-6ab7-4c37-9fec-fe10d466ff9f taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.666886] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-8f367f00-6ab7-4c37-9fec-fe10d466ff9f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.666886] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-8f367f00-6ab7-4c37-9fec-fe10d466ff9f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.667987] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-8f367f00-6ab7-4c37-9fec-fe10d466ff9f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.667987] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f367f00-6ab7-4c37-9fec-fe10d466ff9f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.677505] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.678171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.678389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.680265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.680265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.680265] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.680265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.680265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.680265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.680265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.680265] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 already deleted. [ 881.680265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.170088] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.170675] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.170950] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.171283] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.171466] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.171833] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 8f367f00-6ab7-4c37-9fec-fe10d466ff9f not found, creating... [ 882.172151] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.172594] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.172774] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.173360] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.173518] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.173971] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.174287] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.174501] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.174855] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.175088] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.175291] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 8f367f00-6ab7-4c37-9fec-fe10d466ff9f is going to be created. [ 882.201976] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.202423] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.202695] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.203013] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.203511] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.203873] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-8f367f00-6ab7-4c37-9fec-fe10d466ff9f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.739783] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: SUCCESS [ 882.740183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.980823] env[65359]: INFO networking_nsxv3.common.synchronization [req-2481d5c8-b13e-41cd-8ce5-2db8eb3cad3a req-9e05e79c-d6e5-4b96-bf6a-c37c2ed265b1 service nova] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_rules [ 882.981116] env[65359]: INFO networking_nsxv3.common.synchronization [req-2481d5c8-b13e-41cd-8ce5-2db8eb3cad3a req-9e05e79c-d6e5-4b96-bf6a-c37c2ed265b1 service nova] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 882.981286] env[65359]: INFO networking_nsxv3.common.synchronization [req-2481d5c8-b13e-41cd-8ce5-2db8eb3cad3a req-9e05e79c-d6e5-4b96-bf6a-c37c2ed265b1 service nova] Enqueued Resource ID: 8f367f00-6ab7-4c37-9fec-fe10d466ff9f with Priority: HIGHEST for action port [ 882.981925] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_rules [ 882.982114] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 882.982269] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f367f00-6ab7-4c37-9fec-fe10d466ff9f with Priority: HIGHEST for action port [ 882.982556] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.982956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.983057] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.983350] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.983500] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.984415] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.984547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.984620] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.984796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.984925] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.985030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.985178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.985259] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.985366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.985498] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.987453] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f367f00-6ab7-4c37-9fec-fe10d466ff9f taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.987583] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f367f00-6ab7-4c37-9fec-fe10d466ff9f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.987671] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f367f00-6ab7-4c37-9fec-fe10d466ff9f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.988147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f367f00-6ab7-4c37-9fec-fe10d466ff9f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.988147] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f367f00-6ab7-4c37-9fec-fe10d466ff9f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.121151] env[65359]: INFO networking_nsxv3.common.synchronization [None req-c6deefe6-8dce-47ec-9c54-4266f8122cde None None] Enqueued Resource ID: 7ce41a24-f853-4852-b9de-ee47b3e938c4 with Priority: HIGHEST for action port [ 883.121768] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ce41a24-f853-4852-b9de-ee47b3e938c4 with Priority: HIGHEST for action port [ 883.122563] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ce41a24-f853-4852-b9de-ee47b3e938c4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.122659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ce41a24-f853-4852-b9de-ee47b3e938c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.122754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ce41a24-f853-4852-b9de-ee47b3e938c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.123721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ce41a24-f853-4852-b9de-ee47b3e938c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.123866] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ce41a24-f853-4852-b9de-ee47b3e938c4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.492918] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.493061] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.493219] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.494128] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f367f00-6ab7-4c37-9fec-fe10d466ff9f with status ACTIVE [ 883.494320] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.494462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.494770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.494770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.494770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.494931] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.495075] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.495135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.495248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.495325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.495501] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.495622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.495690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.495777] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.495851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.495933] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f367f00-6ab7-4c37-9fec-fe10d466ff9f is going to be updated. [ 883.520683] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.520924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.520924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.521163] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.521301] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.521633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f367f00-6ab7-4c37-9fec-fe10d466ff9f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.544288] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 in Status: SUCCESS [ 883.544520] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.627410] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ce41a24-f853-4852-b9de-ee47b3e938c4 [ 883.627410] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.627410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.627410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.627410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.627410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.627410] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ce41a24-f853-4852-b9de-ee47b3e938c4 already deleted. [ 883.627410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ce41a24-f853-4852-b9de-ee47b3e938c4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.713333] env[65359]: INFO networking_nsxv3.common.synchronization [req-ef827bac-9920-4205-bfb1-894d8e537104 req-78d4d2f7-1441-4cee-8faa-75553165e0ac tempest-ServerAddressesTestJSON-1604163155 tempest-ServerAddressesTestJSON-1604163155-project-member] Enqueued Resource ID: e87bd638-a489-4449-9e26-acf0926c56dc with Priority: HIGHEST for action security_group_members [ 883.713333] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e87bd638-a489-4449-9e26-acf0926c56dc with Priority: HIGHEST for action security_group_members [ 883.713853] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-e87bd638-a489-4449-9e26-acf0926c56dc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.714052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.714148] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.714407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.714778] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.714902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.714977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.715209] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.715326] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.715441] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e87bd638-a489-4449-9e26-acf0926c56dc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.920484] env[65359]: INFO networking_nsxv3.common.synchronization [req-064b6d8f-30b1-49d6-9b13-ef9f6746eed5 req-1cd440ec-052d-4f10-bf34-3aff20c814f9 tempest-ServersTestMultiNic-532988977 tempest-ServersTestMultiNic-532988977-project-member] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 883.921586] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 883.921586] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.921726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.921726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.921901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.922976] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.922976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.922976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.923202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.923971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.923971] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.000469] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.220835] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.220835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.220835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.220835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.220835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.220835] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.220835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.220835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.220835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.220835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.220835] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e87bd638-a489-4449-9e26-acf0926c56dc is going to be updated. [ 884.259642] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.259932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.260161] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.260639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.260811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.277469] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e87bd638-a489-4449-9e26-acf0926c56dc in Status: IN_PROGRESS for 2s [ 884.395726] env[65359]: INFO networking_nsxv3.common.synchronization [req-064b6d8f-30b1-49d6-9b13-ef9f6746eed5 req-6626c5ef-9047-41ed-8df5-26caa4c9bf3e tempest-ServersTestMultiNic-532988977 tempest-ServersTestMultiNic-532988977-project-member] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 884.396398] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 884.396709] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.396809] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.427410] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.427575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.427647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.428415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.428499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.428739] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.428917] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.428991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.429278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.429355] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.429789] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be deleted. [ 884.472119] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.472560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.472560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.472732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.473611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.473767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.473948] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.474154] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.475773] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.477053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.477053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.477053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.477053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.477777] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.504791] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.504791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.504791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.504791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.504791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.505103] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 is going to be created. [ 884.538831] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.538978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.538978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.540135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.540344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.559655] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: UNINITIALIZED for 2s [ 884.907131] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-325 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.907341] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-325" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.907468] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-325" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.907806] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-325" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.909036] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.909266] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.909424] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.909718] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.909884] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.910186] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.910310] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.910428] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.910540] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.910663] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.910772] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.910907] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.940560] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.940560] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 884.940925] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.940925] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-325" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.941884] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-192adaa8-db88-4c47-8b8c-8552a00f4270 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.941884] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-192adaa8-db88-4c47-8b8c-8552a00f4270" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.941884] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-192adaa8-db88-4c47-8b8c-8552a00f4270" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.941884] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-192adaa8-db88-4c47-8b8c-8552a00f4270" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.942073] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('192adaa8-db88-4c47-8b8c-8552a00f4270',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.982975] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.982975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.982975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.982975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.982975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.983224] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.983224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.983224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.983423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.983507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.983599] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b already deleted. [ 884.983697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.165090] env[65359]: INFO networking_nsxv3.common.synchronization [None req-93516b05-9603-43bf-a593-80b73b99b417 tempest-ServersTestBootFromVolume-259238566 tempest-ServersTestBootFromVolume-259238566-project-member] Enqueued Resource ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d with Priority: HIGHEST for action security_group_rules [ 885.165723] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d with Priority: HIGHEST for action security_group_rules [ 885.166156] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a269c68-1fd7-4085-a1d3-54f407762a6d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.166326] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.166418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.166980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.166980] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a269c68-1fd7-4085-a1d3-54f407762a6d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.346360] env[65359]: INFO networking_nsxv3.common.synchronization [None req-2b0b3c86-1ecb-4626-9d57-e117255b370b tempest-ServersTestBootFromVolume-259238566 tempest-ServersTestBootFromVolume-259238566-project-member] Enqueued Resource ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d with Priority: HIGHEST for action security_group_rules [ 885.347293] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d with Priority: HIGHEST for action security_group_rules [ 885.347670] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a269c68-1fd7-4085-a1d3-54f407762a6d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.347820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.446806] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.446806] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.446806] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.446806] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.446806] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.446806] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 192adaa8-db88-4c47-8b8c-8552a00f4270 not found, creating... [ 885.446806] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.446806] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.446806] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.447637] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.447728] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.448201] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.448410] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.448543] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.448831] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.449071] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.449246] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 192adaa8-db88-4c47-8b8c-8552a00f4270 is going to be created. [ 885.479288] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.479528] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.480658] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.480658] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.480658] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.480658] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-192adaa8-db88-4c47-8b8c-8552a00f4270" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.689877] env[65359]: INFO networking_nsxv3.common.synchronization [None req-bb881225-38d9-428e-a557-d14d773d32a1 None None] Enqueued Resource ID: 213362e3-eb5c-426a-805d-c4178f9205d0 with Priority: HIGHEST for action port [ 885.689877] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 213362e3-eb5c-426a-805d-c4178f9205d0 with Priority: HIGHEST for action port [ 885.690172] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-213362e3-eb5c-426a-805d-c4178f9205d0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.690428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-213362e3-eb5c-426a-805d-c4178f9205d0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.690570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-213362e3-eb5c-426a-805d-c4178f9205d0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.690897] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-213362e3-eb5c-426a-805d-c4178f9205d0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.691079] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('213362e3-eb5c-426a-805d-c4178f9205d0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.697828] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.697828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.697828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.697828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.697828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.697828] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d already deleted. [ 885.697828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.697828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.697828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.697828] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a269c68-1fd7-4085-a1d3-54f407762a6d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.197983] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 213362e3-eb5c-426a-805d-c4178f9205d0 [ 886.197983] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.197983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.197983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.197983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.197983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.197983] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:213362e3-eb5c-426a-805d-c4178f9205d0 already deleted. [ 886.197983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-213362e3-eb5c-426a-805d-c4178f9205d0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.227492] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.227655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.227786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.227925] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.228099] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.228270] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d already deleted. [ 886.228389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.289508] env[65359]: INFO networking_nsxv3.common.synchronization [req-064b6d8f-30b1-49d6-9b13-ef9f6746eed5 req-ae48d7cd-e15f-4a52-9dc4-62a665675c57 service nova] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_rules [ 886.289508] env[65359]: INFO networking_nsxv3.common.synchronization [req-064b6d8f-30b1-49d6-9b13-ef9f6746eed5 req-ae48d7cd-e15f-4a52-9dc4-62a665675c57 service nova] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 886.289655] env[65359]: INFO networking_nsxv3.common.synchronization [req-064b6d8f-30b1-49d6-9b13-ef9f6746eed5 req-ae48d7cd-e15f-4a52-9dc4-62a665675c57 service nova] Enqueued Resource ID: 192adaa8-db88-4c47-8b8c-8552a00f4270 with Priority: HIGHEST for action port [ 886.290266] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_rules [ 886.290447] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 886.290553] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 192adaa8-db88-4c47-8b8c-8552a00f4270 with Priority: HIGHEST for action port [ 886.291178] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.291380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.291380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.291568] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.291650] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.295232] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.295360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.295435] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.295720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.296490] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.296490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.296490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.296490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.296490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.296655] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.301489] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-192adaa8-db88-4c47-8b8c-8552a00f4270 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.301489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-192adaa8-db88-4c47-8b8c-8552a00f4270" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.301627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-192adaa8-db88-4c47-8b8c-8552a00f4270" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.303104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-192adaa8-db88-4c47-8b8c-8552a00f4270" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.303104] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('192adaa8-db88-4c47-8b8c-8552a00f4270',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.306922] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e87bd638-a489-4449-9e26-acf0926c56dc in Status: SUCCESS [ 886.307353] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e87bd638-a489-4449-9e26-acf0926c56dc deletion is rescheduled due to dependency. [ 886.307353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e87bd638-a489-4449-9e26-acf0926c56dc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.573623] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: SUCCESS [ 886.573780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.573925] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.574191] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.574425] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.574580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.574698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.574819] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.574920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.575062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.575143] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.639538] env[65359]: INFO networking_nsxv3.common.synchronization [req-e265e279-8c7f-445e-a009-24deb16c0182 req-352b2f6a-6d4d-49ab-b6df-2fc880fc5381 tempest-ServersTestJSON-1929866617 tempest-ServersTestJSON-1929866617-project-member] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 886.640380] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 886.640741] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.640886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.640973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.642043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.642043] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.642043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.642043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.642043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.642043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.642043] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.796118] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.796259] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.800728] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.806549] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 192adaa8-db88-4c47-8b8c-8552a00f4270 with status ACTIVE [ 886.806785] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.806932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.807020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.807247] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.807330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.807502] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.807599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.807661] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.807811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.807888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.808077] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.808286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.808286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.808372] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.808571] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.808571] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 192adaa8-db88-4c47-8b8c-8552a00f4270 is going to be updated. [ 886.835844] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.835844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.835844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.836125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.836229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.836413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-192adaa8-db88-4c47-8b8c-8552a00f4270" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.951785] env[65359]: INFO networking_nsxv3.common.synchronization [req-5130f4c1-3c00-4d86-9e05-b3c6680a6af3 req-dc4501f1-7940-4fc3-a8d1-e6a3b0c7ac6b tempest-ImagesOneServerNegativeTestJSON-1491004073 tempest-ImagesOneServerNegativeTestJSON-1491004073-project-member] Enqueued Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 886.952404] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 886.952721] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.952865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.953013] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.953227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.953399] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.953537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.953607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.953815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.953931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.954110] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.072339] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.072339] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.072339] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.072339] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.072339] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.072339] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.072880] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.072880] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.073092] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.073381] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.074283] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.074534] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.074784] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.074952] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.075123] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.075339] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.080586] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.098720] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.098945] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 887.099149] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.099370] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.099727] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-26d4d1e7-75f1-4555-9a0f-bb0a9d48f348 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.099913] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-26d4d1e7-75f1-4555-9a0f-bb0a9d48f348" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.100046] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-26d4d1e7-75f1-4555-9a0f-bb0a9d48f348" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.100514] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-26d4d1e7-75f1-4555-9a0f-bb0a9d48f348" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.100717] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26d4d1e7-75f1-4555-9a0f-bb0a9d48f348',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.144652] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.304162] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.397584] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-24 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.397783] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-24" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.397923] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-24" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.398296] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-24" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.398584] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.398750] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.398867] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.399097] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.399269] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.399483] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.399594] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.399698] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.399805] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.399926] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.400041] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.400166] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.426317] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.426516] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 887.426633] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.426845] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-24" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.427189] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-3a549138-3501-4674-98c9-63ccec874449 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.427381] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-3a549138-3501-4674-98c9-63ccec874449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.427511] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-3a549138-3501-4674-98c9-63ccec874449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.427843] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-3a549138-3501-4674-98c9-63ccec874449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.427982] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a549138-3501-4674-98c9-63ccec874449',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.456445] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.456670] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.456670] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.456900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.456994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.457208] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.457347] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.457413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.457571] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.457647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.457738] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 is going to be updated. [ 887.490570] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.490797] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.490797] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.491038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.491211] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.502867] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: IN_PROGRESS for 2s [ 887.582996] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93f7f41b-56ed-4593-aafe-31057cf7c6f5: rpc.has_security_group_logging(os_id): False [ 887.605258] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.605519] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.605679] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.606016] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.606242] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.606490] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 26d4d1e7-75f1-4555-9a0f-bb0a9d48f348 not found, creating... [ 887.606789] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.607023] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.607160] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.607515] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.607826] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.608254] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.608575] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.608706] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.608980] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.609207] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.609429] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 26d4d1e7-75f1-4555-9a0f-bb0a9d48f348 is going to be created. [ 887.611613] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.611767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.611810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.611957] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.612051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.612362] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.612483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.612640] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.612807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.612885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.612975] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 is going to be created. [ 887.639999] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.640436] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.640591] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.641040] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.641545] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.641889] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-26d4d1e7-75f1-4555-9a0f-bb0a9d48f348" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.648164] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.692426] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.692755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.692922] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.693314] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.693647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.728252] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: IN_PROGRESS for 2s [ 887.809039] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.809039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.809039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.809300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.809300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.809474] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be created. [ 887.857273] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.857498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.857550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.857807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.858071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.875580] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: UNINITIALIZED for 2s [ 887.930808] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.931086] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.931222] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.931527] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.931698] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.931981] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 3a549138-3501-4674-98c9-63ccec874449 not found, creating... [ 887.932504] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.932811] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.933064] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.933294] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.933501] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.933914] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.934192] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.934242] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.934496] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.934629] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.934772] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 3a549138-3501-4674-98c9-63ccec874449 is going to be created. [ 887.964308] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.964533] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.964693] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.965123] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.965378] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.965656] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-3a549138-3501-4674-98c9-63ccec874449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.151168] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.151452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.151503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.151878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.152020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.152179] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 888.201731] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.202054] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.202165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.202402] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.202564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.218471] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 888.376832] env[65359]: INFO networking_nsxv3.common.synchronization [req-e265e279-8c7f-445e-a009-24deb16c0182 req-aab78d07-264b-49ca-babe-b153b091aa80 service nova] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_rules [ 888.377410] env[65359]: INFO networking_nsxv3.common.synchronization [req-e265e279-8c7f-445e-a009-24deb16c0182 req-aab78d07-264b-49ca-babe-b153b091aa80 service nova] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 888.377410] env[65359]: INFO networking_nsxv3.common.synchronization [req-e265e279-8c7f-445e-a009-24deb16c0182 req-aab78d07-264b-49ca-babe-b153b091aa80 service nova] Enqueued Resource ID: 26d4d1e7-75f1-4555-9a0f-bb0a9d48f348 with Priority: HIGHEST for action port [ 888.377653] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_rules [ 888.377793] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 888.377891] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d4d1e7-75f1-4555-9a0f-bb0a9d48f348 with Priority: HIGHEST for action port [ 888.378246] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.378327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.378439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.378717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.378851] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.379982] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.380278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.380434] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-26d4d1e7-75f1-4555-9a0f-bb0a9d48f348 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.380552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26d4d1e7-75f1-4555-9a0f-bb0a9d48f348" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.380657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26d4d1e7-75f1-4555-9a0f-bb0a9d48f348" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.380825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26d4d1e7-75f1-4555-9a0f-bb0a9d48f348" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.380910] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26d4d1e7-75f1-4555-9a0f-bb0a9d48f348',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.727306] env[65359]: INFO networking_nsxv3.common.synchronization [req-064b6d8f-30b1-49d6-9b13-ef9f6746eed5 req-12c50bc9-2ba9-4c70-8692-894c0c53c7f9 service nova] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_rules [ 888.728581] env[65359]: INFO networking_nsxv3.common.synchronization [req-064b6d8f-30b1-49d6-9b13-ef9f6746eed5 req-12c50bc9-2ba9-4c70-8692-894c0c53c7f9 service nova] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 888.728581] env[65359]: INFO networking_nsxv3.common.synchronization [req-064b6d8f-30b1-49d6-9b13-ef9f6746eed5 req-12c50bc9-2ba9-4c70-8692-894c0c53c7f9 service nova] Enqueued Resource ID: 3a549138-3501-4674-98c9-63ccec874449 with Priority: HIGHEST for action port [ 888.728581] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_rules [ 888.728581] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 888.728581] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a549138-3501-4674-98c9-63ccec874449 with Priority: HIGHEST for action port [ 888.728821] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.728893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.729099] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.729181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.729383] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a549138-3501-4674-98c9-63ccec874449 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.729517] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a549138-3501-4674-98c9-63ccec874449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.729615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a549138-3501-4674-98c9-63ccec874449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.729840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a549138-3501-4674-98c9-63ccec874449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.729925] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a549138-3501-4674-98c9-63ccec874449',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.885184] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.885375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.885553] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26d4d1e7-75f1-4555-9a0f-bb0a9d48f348 with status ACTIVE [ 888.885802] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.886052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.886719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.886719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.886719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.887404] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.887404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.887404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.887524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.887710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.887864] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.888055] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.888183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.888905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.888905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.888905] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26d4d1e7-75f1-4555-9a0f-bb0a9d48f348 is going to be updated. [ 888.919093] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.919093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.919093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.919093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.919093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.919762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26d4d1e7-75f1-4555-9a0f-bb0a9d48f348" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.234305] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a549138-3501-4674-98c9-63ccec874449 with status ACTIVE [ 889.234712] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.235095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.235095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.235255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.235255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.236761] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.236761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.236761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.236761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.236761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.236761] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.236761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.236761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.236761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.236761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.236761] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a549138-3501-4674-98c9-63ccec874449 is going to be updated. [ 889.271852] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.271852] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.271852] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.271852] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.271852] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.271852] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a549138-3501-4674-98c9-63ccec874449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.519456] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: SUCCESS [ 889.519835] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 deletion is rescheduled due to dependency. [ 889.519835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.743492] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: SUCCESS [ 889.743492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.887458] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 889.887458] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.887458] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.887714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.888268] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.888268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.888268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.890967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.890967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.890967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.890967] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.890967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.890967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.891204] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.891285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.891403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.891692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.891830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.891898] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.235721] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 890.237023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.237865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.238209] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.239907] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.240067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.240296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.240404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.240526] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.240697] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.392930] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.393154] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.395026] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.746199] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.898558] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.251437] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.401875] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.401875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.402086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.402255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.402401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.402527] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be updated. [ 891.433131] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.433388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.433464] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.433707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.433954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.463064] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: IN_PROGRESS for 2s [ 891.622423] env[65359]: INFO networking_nsxv3.common.synchronization [req-34d391a4-51e3-4ada-94a7-bc61556f710c req-feeeffb1-ada6-4cf0-b77c-e0ce1c4c177e tempest-ServerRescueTestJSONUnderV235-1107401674 tempest-ServerRescueTestJSONUnderV235-1107401674-project-member] Enqueued Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_members [ 891.622622] env[65359]: INFO networking_nsxv3.common.synchronization [req-34d391a4-51e3-4ada-94a7-bc61556f710c req-feeeffb1-ada6-4cf0-b77c-e0ce1c4c177e tempest-ServerRescueTestJSONUnderV235-1107401674 tempest-ServerRescueTestJSONUnderV235-1107401674-project-member] Enqueued Resource ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 with Priority: HIGHEST for action security_group_members [ 891.623194] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_members [ 891.623313] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 with Priority: HIGHEST for action security_group_members [ 891.623612] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.623737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.623825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.623998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.624302] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.624414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.624475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.624636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.624721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.624812] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.625795] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.625908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.625974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.626316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.626470] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.626586] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.626713] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.626872] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.626955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.627081] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9d8121d-c701-4c1c-a72d-cb65cd21cff0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.686203] env[65359]: INFO networking_nsxv3.common.synchronization [req-34d391a4-51e3-4ada-94a7-bc61556f710c req-feeeffb1-ada6-4cf0-b77c-e0ce1c4c177e tempest-ServerRescueTestJSONUnderV235-1107401674 tempest-ServerRescueTestJSONUnderV235-1107401674-project-member] Enqueued Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_rules [ 891.686387] env[65359]: INFO networking_nsxv3.common.synchronization [req-34d391a4-51e3-4ada-94a7-bc61556f710c req-feeeffb1-ada6-4cf0-b77c-e0ce1c4c177e tempest-ServerRescueTestJSONUnderV235-1107401674 tempest-ServerRescueTestJSONUnderV235-1107401674-project-member] Enqueued Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_members [ 891.686526] env[65359]: INFO networking_nsxv3.common.synchronization [req-34d391a4-51e3-4ada-94a7-bc61556f710c req-feeeffb1-ada6-4cf0-b77c-e0ce1c4c177e tempest-ServerRescueTestJSONUnderV235-1107401674 tempest-ServerRescueTestJSONUnderV235-1107401674-project-member] Enqueued Resource ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 with Priority: HIGHEST for action security_group_rules [ 891.686647] env[65359]: INFO networking_nsxv3.common.synchronization [req-34d391a4-51e3-4ada-94a7-bc61556f710c req-feeeffb1-ada6-4cf0-b77c-e0ce1c4c177e tempest-ServerRescueTestJSONUnderV235-1107401674 tempest-ServerRescueTestJSONUnderV235-1107401674-project-member] Enqueued Resource ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 with Priority: HIGHEST for action security_group_members [ 891.686770] env[65359]: INFO networking_nsxv3.common.synchronization [req-34d391a4-51e3-4ada-94a7-bc61556f710c req-feeeffb1-ada6-4cf0-b77c-e0ce1c4c177e tempest-ServerRescueTestJSONUnderV235-1107401674 tempest-ServerRescueTestJSONUnderV235-1107401674-project-member] Enqueued Resource ID: 1528d181-0dbe-443b-b3f6-3441f18183e9 with Priority: HIGHEST for action port [ 891.687324] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_rules [ 891.687460] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 with Priority: HIGHEST for action security_group_rules [ 891.687568] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1528d181-0dbe-443b-b3f6-3441f18183e9 with Priority: HIGHEST for action port [ 891.687702] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_members [ 891.687810] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 with Priority: HIGHEST for action security_group_members [ 891.688166] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.690323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.690323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.690323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.690323] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.690323] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9d8121d-c701-4c1c-a72d-cb65cd21cff0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.690323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.690323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.690633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.690633] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9d8121d-c701-4c1c-a72d-cb65cd21cff0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.691370] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-1528d181-0dbe-443b-b3f6-3441f18183e9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.691480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.691544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.691710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.691783] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1528d181-0dbe-443b-b3f6-3441f18183e9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.692612] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.692724] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.693007] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.693387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.754599] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.755044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.755044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.755214] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.755313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.755444] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 891.796412] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.796617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.796691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.796950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.797137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.807946] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 892.128978] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.129998] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9d8121d-c701-4c1c-a72d-cb65cd21cff0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.197717] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.197717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.197717] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.197717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.197717] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1528d181-0dbe-443b-b3f6-3441f18183e9 with status ACTIVE [ 892.197717] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.197717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.197717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.197717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.197717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.197717] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.198582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.198582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.198582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.198582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.202043] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.202043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.202043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.202043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.202043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.202043] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1528d181-0dbe-443b-b3f6-3441f18183e9 is going to be updated. [ 892.240123] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.240405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.240467] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.240813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.241495] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.241853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.277172] env[65359]: INFO networking_nsxv3.common.synchronization [req-85f1eaeb-0f31-4c58-be47-ef1ce85f6639 req-2eb063ca-61f4-4134-a701-d2df3786085c tempest-ServerRescueTestJSONUnderV235-1107401674 tempest-ServerRescueTestJSONUnderV235-1107401674-project-member] Enqueued Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_members [ 892.277389] env[65359]: INFO networking_nsxv3.common.synchronization [req-85f1eaeb-0f31-4c58-be47-ef1ce85f6639 req-2eb063ca-61f4-4134-a701-d2df3786085c tempest-ServerRescueTestJSONUnderV235-1107401674 tempest-ServerRescueTestJSONUnderV235-1107401674-project-member] Enqueued Resource ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 with Priority: HIGHEST for action security_group_members [ 892.279711] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_members [ 892.279891] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 with Priority: HIGHEST for action security_group_members [ 892.280636] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.280749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.280983] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.281101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.343185] env[65359]: INFO networking_nsxv3.common.synchronization [req-85f1eaeb-0f31-4c58-be47-ef1ce85f6639 req-2eb063ca-61f4-4134-a701-d2df3786085c tempest-ServerRescueTestJSONUnderV235-1107401674 tempest-ServerRescueTestJSONUnderV235-1107401674-project-member] Enqueued Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_rules [ 892.343185] env[65359]: INFO networking_nsxv3.common.synchronization [req-85f1eaeb-0f31-4c58-be47-ef1ce85f6639 req-2eb063ca-61f4-4134-a701-d2df3786085c tempest-ServerRescueTestJSONUnderV235-1107401674 tempest-ServerRescueTestJSONUnderV235-1107401674-project-member] Enqueued Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_members [ 892.343185] env[65359]: INFO networking_nsxv3.common.synchronization [req-85f1eaeb-0f31-4c58-be47-ef1ce85f6639 req-2eb063ca-61f4-4134-a701-d2df3786085c tempest-ServerRescueTestJSONUnderV235-1107401674 tempest-ServerRescueTestJSONUnderV235-1107401674-project-member] Enqueued Resource ID: 1528d181-0dbe-443b-b3f6-3441f18183e9 with Priority: HIGHEST for action port [ 892.343185] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_rules [ 892.343185] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_members [ 892.343185] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1528d181-0dbe-443b-b3f6-3441f18183e9 with Priority: HIGHEST for action port [ 892.343185] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.343185] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.343631] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.343631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.343631] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-1528d181-0dbe-443b-b3f6-3441f18183e9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.343730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.343761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.343970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.344033] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1528d181-0dbe-443b-b3f6-3441f18183e9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.631418] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.634120] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9d8121d-c701-4c1c-a72d-cb65cd21cff0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.847206] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1528d181-0dbe-443b-b3f6-3441f18183e9 with status ACTIVE [ 892.847528] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.847528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.847528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.848167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.848167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.848268] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.848414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.848503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.848749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.848996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.849185] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.849342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.849440] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.850568] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.850709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.850842] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1528d181-0dbe-443b-b3f6-3441f18183e9 is going to be updated. [ 892.874377] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.874589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.874589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.874811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.874938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.875112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1528d181-0dbe-443b-b3f6-3441f18183e9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.133580] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.133760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.133907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.134183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.134308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.134433] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 is going to be updated. [ 893.137481] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.137481] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.137690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.137781] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.137865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.138045] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 is going to be created. [ 893.164029] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.164249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.164346] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.164638] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.164856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.168273] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.168451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.168726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.168815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.168997] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.176691] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 in Status: UNINITIALIZED for 2s [ 893.177751] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: IN_PROGRESS for 2s [ 893.480166] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 893.480468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.480654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.480917] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.481621] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.481621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.481621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.481621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.481893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.481893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.482021] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.482101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.482152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.482391] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.482552] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.482652] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.482717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.482976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.483088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.483207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.483343] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.826091] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 893.826366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.826651] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.826910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.827181] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.827321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.827395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.827617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.827737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.827889] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.827990] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.985667] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 153868d0-4b9a-4493-8289-08b4b26dc07b: rpc.has_security_group_logging(os_id): False [ 894.011691] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.011991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.012153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.012532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.012723] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.013110] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.013263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.013350] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.013605] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.013703] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.013945] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.014077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.014150] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.014525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.014525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.014645] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.014747] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.014811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.014961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.015995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.016627] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be created. [ 894.129623] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.129861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.129966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.130430] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.130874] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.145667] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: IN_PROGRESS for 2s [ 894.330613] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.330828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.330909] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.331115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.331321] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.331411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.331462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.331619] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.331761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.331873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.332030] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.332127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.332190] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.332389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.332514] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.332612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.332672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.332876] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.332981] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.333092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.333188] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.841444] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5: rpc.has_security_group_logging(os_id): False [ 894.862046] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.862225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.862296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.862557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.889471] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.889837] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.891070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.891070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.891070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.891070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.891070] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.891283] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.891283] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.891417] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.891497] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.891719] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.892116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.892116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.892116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.892116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.892468] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 894.990770] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.990770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.990770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.991178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.991178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.996049] env[65359]: INFO networking_nsxv3.common.synchronization [req-31a5eb6f-25e2-4f60-aec3-39d92b602b8e req-08b45ddc-c004-4920-af46-0b5459550ec5 tempest-ServersAdminTestJSON-387763736 tempest-ServersAdminTestJSON-387763736-project-member] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 894.997049] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGHEST for action security_group_members [ 894.997049] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.997049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.998339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.998339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.998339] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.998339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.998339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.998339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.998339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.998339] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.008309] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 895.189294] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: SUCCESS [ 895.189658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.190014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.190370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.191223] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.191564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.191643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.191957] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.192195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.192426] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.195733] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 in Status: SUCCESS [ 895.196316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.196705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.197104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.197434] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.197674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.198185] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.198185] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.198377] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.198620] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9d8121d-c701-4c1c-a72d-cb65cd21cff0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.500977] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.501235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.501235] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.501502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.501597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.501795] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.501887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.501961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.502243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.502425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.502549] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be updated. [ 895.531348] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.531513] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.531620] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.531803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.532021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.542384] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: IN_PROGRESS for 2s [ 895.697392] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.701897] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.701897] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.702105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.702182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.702361] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.703093] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.703221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.703273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.703530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.703655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.703710] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 is going to be deleted. [ 895.739139] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.739334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.739386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.739586] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.739691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.739782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.739943] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.740111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.740301] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.740537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.740537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.740688] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.740688] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.740796] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9d8121d-c701-4c1c-a72d-cb65cd21cff0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.158988] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 896.159484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.159484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.159790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.159790] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.200682] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.243954] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.244196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.244275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.244538] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.244657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.244937] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.244937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.245179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.245179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.245279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.245509] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 already deleted. [ 896.245665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.245828] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9d8121d-c701-4c1c-a72d-cb65cd21cff0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.246639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.248475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.248475] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.248475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.248475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.248475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.248475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.248475] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9d8121d-c701-4c1c-a72d-cb65cd21cff0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.665842] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.665842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.665842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.665842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.665842] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.665842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.665842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.665842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.665842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.665842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.665842] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.704529] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.707244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.707244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.707244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.707244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.707244] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 is going to be updated. [ 896.744204] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.744409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.744475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.744881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.744920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.749024] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9d8121d-c701-4c1c-a72d-cb65cd21cff0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.750645] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.750800] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.750870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.751130] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.751239] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.751511] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.751642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.751714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.751901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.751976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.752089] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 already deleted. [ 896.752204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.756831] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: IN_PROGRESS for 2s [ 897.030550] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 897.030865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.174533] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.174533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.174533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.174533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.174533] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.174533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.174533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.174533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.174533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.174533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.174533] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.174533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.174533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.174533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.174533] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.174533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.175440] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.175440] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.175440] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.175440] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.175440] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.251548] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9d8121d-c701-4c1c-a72d-cb65cd21cff0: rpc.has_security_group_logging(os_id): False [ 897.272962] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.276022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.276022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.276022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.276022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.276022] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.276022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.276022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.276022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.276022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.276022] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 is going to be created. [ 897.318673] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/c9d8121d-c701-4c1c-a72d-cb65cd21cff0], does not exist path=[/infra/domains/default/groups/c9d8121d-c701-4c1c-a72d-cb65cd21cff0]."\n}' [ 897.318822] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c9d8121d-c701-4c1c-a72d-cb65cd21cff0 [ 897.318910] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 897.363826] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.364268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.364268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.365067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.366462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.366840] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.367012] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.367130] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.367613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.367799] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.368108] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.368263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.368370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.368773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.368999] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.369216] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9d8121d-c701-4c1c-a72d-cb65cd21cff0 is going to be created. [ 897.391738] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/c9d8121d-c701-4c1c-a72d-cb65cd21cff0], does not exist path=[/infra/domains/default/groups/c9d8121d-c701-4c1c-a72d-cb65cd21cff0]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c9d8121d-c701-4c1c-a72d-cb65cd21cff0 [ 897.392025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9d8121d-c701-4c1c-a72d-cb65cd21cff0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.393836] env[65359]: Traceback (most recent call last): [ 897.393836] env[65359]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 897.393836] env[65359]: return func(*args, **kwargs) [ 897.393836] env[65359]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 897.393836] env[65359]: res.raise_for_status() [ 897.393836] env[65359]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 897.393836] env[65359]: raise HTTPError(http_error_msg, response=self) [ 897.393836] env[65359]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c9d8121d-c701-4c1c-a72d-cb65cd21cff0 [ 897.393836] env[65359]: During handling of the above exception, another exception occurred: [ 897.393836] env[65359]: Traceback (most recent call last): [ 897.393836] env[65359]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 897.393836] env[65359]: listener.cb(fileno) [ 897.393836] env[65359]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 897.393836] env[65359]: result = function(*args, **kwargs) [ 897.393836] env[65359]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 897.393836] env[65359]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 897.393836] env[65359]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 897.393836] env[65359]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 897.393836] env[65359]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 897.393836] env[65359]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 897.393836] env[65359]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 897.393836] env[65359]: res.raise_for_status() [ 897.393836] env[65359]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 897.393836] env[65359]: raise HTTPError(http_error_msg, response=self) [ 897.393836] env[65359]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c9d8121d-c701-4c1c-a72d-cb65cd21cff0 [ 897.393836] env[65359]: Removing descriptor: 67 [ 897.557138] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc in Status: SUCCESS [ 897.557336] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc deletion is rescheduled due to dependency. [ 897.557459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.682347] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 153868d0-4b9a-4493-8289-08b4b26dc07b: rpc.has_security_group_logging(os_id): False [ 897.706923] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.707227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.707312] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.709553] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.736316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.736316] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.737182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.737182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.737182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.737182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.737182] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.738905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.738905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.738905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.738905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.738905] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.738905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.738905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.738905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.738905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.738905] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be updated. [ 897.835715] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.836184] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.836184] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.836184] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.836412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.852034] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: IN_PROGRESS for 2s [ 898.770028] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: SUCCESS [ 898.770028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.770028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.770028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.770028] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.770028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.770028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.770028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.770028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.770028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.770028] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.772441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.772441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.772582] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.772722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.772779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.772938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.773016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.773107] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.184520] env[65359]: INFO networking_nsxv3.common.synchronization [None req-7e63a94c-151d-4ae2-8507-1a8b703441ae None None] Enqueued Resource ID: be992ac2-3ec2-4283-855a-b373007a9aab with Priority: HIGHEST for action port [ 899.185158] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be992ac2-3ec2-4283-855a-b373007a9aab with Priority: HIGHEST for action port [ 899.185528] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-be992ac2-3ec2-4283-855a-b373007a9aab taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.185723] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be992ac2-3ec2-4283-855a-b373007a9aab" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.185839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be992ac2-3ec2-4283-855a-b373007a9aab" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.186148] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be992ac2-3ec2-4283-855a-b373007a9aab" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.186280] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be992ac2-3ec2-4283-855a-b373007a9aab',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.273077] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.273584] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.277440] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.690445] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be992ac2-3ec2-4283-855a-b373007a9aab [ 899.691073] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.692163] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.692273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.692581] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.692722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.692797] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be992ac2-3ec2-4283-855a-b373007a9aab already deleted. [ 899.692865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be992ac2-3ec2-4283-855a-b373007a9aab" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.781998] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.870710] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 899.870710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.285863] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.285938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.286034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.286280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.286395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.286493] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 is going to be updated. [ 900.324153] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.324290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.324380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.324560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.324710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.335195] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: IN_PROGRESS for 2s [ 900.433636] env[65359]: INFO networking_nsxv3.common.synchronization [None req-fb9f4d84-0e48-40de-ae92-7494a1ee6a9a tempest-ServerActionsV293TestJSON-1704396028 tempest-ServerActionsV293TestJSON-1704396028-project-member] Enqueued Resource ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e with Priority: HIGHEST for action security_group_rules [ 900.434273] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e with Priority: HIGHEST for action security_group_rules [ 900.434700] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.434700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.435091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.435395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.435496] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c69a6fc7-9355-4fca-ac8f-5d59227f6c2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.592290] env[65359]: INFO networking_nsxv3.common.synchronization [None req-fd6d2c3a-dbfa-4da4-905f-e58de77d2a66 tempest-ServerActionsV293TestJSON-1704396028 tempest-ServerActionsV293TestJSON-1704396028-project-member] Enqueued Resource ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e with Priority: HIGHEST for action security_group_rules [ 900.592937] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e with Priority: HIGHEST for action security_group_rules [ 900.593272] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.593491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.618891] env[65359]: INFO networking_nsxv3.common.synchronization [None req-0db053ba-a997-487e-b656-881239aff05b tempest-ServerRescueNegativeTestJSON-174363340 tempest-ServerRescueNegativeTestJSON-174363340-project-member] Enqueued Resource ID: c5b458df-8f8e-47b7-9e32-899c590c5940 with Priority: HIGHEST for action security_group_rules [ 900.618891] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b458df-8f8e-47b7-9e32-899c590c5940 with Priority: HIGHEST for action security_group_rules [ 900.618975] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5b458df-8f8e-47b7-9e32-899c590c5940 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.619945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.620038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.620290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.620382] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5b458df-8f8e-47b7-9e32-899c590c5940',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.752408] env[65359]: INFO networking_nsxv3.common.synchronization [None req-cd20ef7a-6351-417e-9f14-0e33b6c58695 tempest-ServerRescueNegativeTestJSON-174363340 tempest-ServerRescueNegativeTestJSON-174363340-project-member] Enqueued Resource ID: c5b458df-8f8e-47b7-9e32-899c590c5940 with Priority: HIGHEST for action security_group_rules [ 900.753738] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b458df-8f8e-47b7-9e32-899c590c5940 with Priority: HIGHEST for action security_group_rules [ 900.753738] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5b458df-8f8e-47b7-9e32-899c590c5940 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.753913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.961034] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.961428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.961428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.962175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.962175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.962175] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e already deleted. [ 900.962175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.962175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.962465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.962532] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c69a6fc7-9355-4fca-ac8f-5d59227f6c2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.155065] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.155065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.155065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.155065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.155065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.155065] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5b458df-8f8e-47b7-9e32-899c590c5940 already deleted. [ 901.155065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.155065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.155065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.155065] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5b458df-8f8e-47b7-9e32-899c590c5940',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.492027] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.492027] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e already deleted. [ 901.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.679479] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.679633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.679739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.679916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.680013] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.680120] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5b458df-8f8e-47b7-9e32-899c590c5940 already deleted. [ 901.680203] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.721537] env[65359]: INFO networking_nsxv3.common.synchronization [None req-50fc5469-8236-4ada-97d1-e9c5ec581646 None None] Enqueued Resource ID: a9aded03-a769-4c0e-a0cf-746b9f02ad83 with Priority: HIGHEST for action port [ 901.722132] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9aded03-a769-4c0e-a0cf-746b9f02ad83 with Priority: HIGHEST for action port [ 901.722503] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9aded03-a769-4c0e-a0cf-746b9f02ad83 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.722578] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9aded03-a769-4c0e-a0cf-746b9f02ad83" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.722667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9aded03-a769-4c0e-a0cf-746b9f02ad83" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.724753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9aded03-a769-4c0e-a0cf-746b9f02ad83" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.724876] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9aded03-a769-4c0e-a0cf-746b9f02ad83',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.230126] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9aded03-a769-4c0e-a0cf-746b9f02ad83 [ 902.230126] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.230126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.230126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.230126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.230126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.232740] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9aded03-a769-4c0e-a0cf-746b9f02ad83 already deleted. [ 902.232740] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9aded03-a769-4c0e-a0cf-746b9f02ad83" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.351225] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: SUCCESS [ 902.351225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.351225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.351225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.351225] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.351225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.351225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.351225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.351225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.351225] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.369792] env[65359]: INFO networking_nsxv3.common.synchronization [req-32e45087-e5e1-463e-bce1-683ca3870bb1 req-220a62e7-305e-4ee0-91aa-6854446d1613 tempest-DeleteServersTestJSON-2065668722 tempest-DeleteServersTestJSON-2065668722-project-member] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 902.370336] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 902.370617] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.370764] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.370851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.371051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.371243] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.371381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.371410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.371561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.371646] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.371797] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.533751] env[65359]: INFO networking_nsxv3.common.synchronization [req-5eec5f33-727b-46c6-9149-1d759e54d660 req-4892b4b6-7e71-4257-9fe0-762ba55088c4 tempest-ServersTestJSON-1929866617 tempest-ServersTestJSON-1929866617-project-member] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 902.534595] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 902.534920] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.536888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.536888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.537097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.537631] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.537770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.540952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.540952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.540952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.540952] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.854571] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.876553] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.876553] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.876553] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.876553] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.899203] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.899675] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.899946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.900122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.900435] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.900613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.900806] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 902.917174] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-125 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.917174] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.917174] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.917312] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.917856] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.918149] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.918333] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.918580] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.918769] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.919023] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.919204] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.919385] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.919589] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.919792] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.920127] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.920368] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.939239] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.939422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.939497] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.939765] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.939959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.945232] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.945679] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 902.945939] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.947583] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.947583] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-b1f5b369-debc-4c9d-b460-8b3231098742 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.947583] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-b1f5b369-debc-4c9d-b460-8b3231098742" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.947583] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-b1f5b369-debc-4c9d-b460-8b3231098742" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.947934] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-b1f5b369-debc-4c9d-b460-8b3231098742" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.947934] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f5b369-debc-4c9d-b460-8b3231098742',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.953932] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 903.037616] env[65359]: INFO networking_nsxv3.common.synchronization [req-82784755-d694-4dcd-9a56-4b4f5e9f4762 req-cf274f69-539f-47e0-88d5-b4dc608a4956 tempest-ServerRescueTestJSONUnderV235-1107401674 tempest-ServerRescueTestJSONUnderV235-1107401674-project-member] Enqueued Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_members [ 903.038408] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 with Priority: HIGHEST for action security_group_members [ 903.038749] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.038879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.046214] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.356363] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.451249] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.451588] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.451847] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.452217] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.452484] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.452735] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port b1f5b369-debc-4c9d-b460-8b3231098742 not found, creating... [ 903.453252] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.453496] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.453647] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.453960] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.454183] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.454567] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.454958] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.455167] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.455451] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.455652] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.456015] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: b1f5b369-debc-4c9d-b460-8b3231098742 is going to be created. [ 903.486218] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.487813] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.487813] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.487813] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.487813] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.487813] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-b1f5b369-debc-4c9d-b460-8b3231098742" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.548054] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.777514] env[65359]: INFO networking_nsxv3.common.synchronization [req-9a09453c-3fb5-43e7-b7d6-53e00bf1e3cd req-dbb5d13c-5493-4b8e-a7d7-b7190109ee69 tempest-ServersTestMultiNic-532988977 tempest-ServersTestMultiNic-532988977-project-member] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 903.778131] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 903.778492] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.778696] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.778777] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.778980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.779202] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.779311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.779409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.779525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.779615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.779709] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.866135] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.866300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.866379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.866706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.866856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.867014] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 is going to be updated. [ 903.905384] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.905708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.905708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.905708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.906116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.916851] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: IN_PROGRESS for 2s [ 904.052831] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.052904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.052938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.054242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.054242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.054242] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 904.088594] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.088771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.089732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.089732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.089732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.109290] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 904.215617] env[65359]: INFO networking_nsxv3.common.synchronization [req-9a09453c-3fb5-43e7-b7d6-53e00bf1e3cd req-9aa2f42e-e41e-412c-b540-9c5cdaff1926 tempest-ServersTestMultiNic-532988977 tempest-ServersTestMultiNic-532988977-project-member] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 904.215939] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGHEST for action security_group_members [ 904.216268] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.216361] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.242109] env[65359]: INFO networking_nsxv3.common.synchronization [req-32e45087-e5e1-463e-bce1-683ca3870bb1 req-f8584882-1270-491e-b78c-16def8b24131 service nova] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_rules [ 904.242268] env[65359]: INFO networking_nsxv3.common.synchronization [req-32e45087-e5e1-463e-bce1-683ca3870bb1 req-f8584882-1270-491e-b78c-16def8b24131 service nova] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 904.242472] env[65359]: INFO networking_nsxv3.common.synchronization [req-32e45087-e5e1-463e-bce1-683ca3870bb1 req-f8584882-1270-491e-b78c-16def8b24131 service nova] Enqueued Resource ID: b1f5b369-debc-4c9d-b460-8b3231098742 with Priority: HIGHEST for action port [ 904.243066] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_rules [ 904.243213] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 904.243309] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f5b369-debc-4c9d-b460-8b3231098742 with Priority: HIGHEST for action port [ 904.243753] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.243961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.244076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.244377] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.244494] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.245725] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.245725] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.245924] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1f5b369-debc-4c9d-b460-8b3231098742 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.246175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1f5b369-debc-4c9d-b460-8b3231098742" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.246257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1f5b369-debc-4c9d-b460-8b3231098742" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.246566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1f5b369-debc-4c9d-b460-8b3231098742" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.246705] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f5b369-debc-4c9d-b460-8b3231098742',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.282253] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.748436] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.748997] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.749552] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1f5b369-debc-4c9d-b460-8b3231098742 with status ACTIVE [ 904.750292] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.750490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.750590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.750907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.751051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.751304] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.751439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.751508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.751786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.751900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.752185] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.752352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.752507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.752708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.752831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.752955] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1f5b369-debc-4c9d-b460-8b3231098742 is going to be updated. [ 904.784905] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.823048] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.823048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.823048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.823847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.823847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.823847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1f5b369-debc-4c9d-b460-8b3231098742" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.983977] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 904.984352] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb deletion is rescheduled due to dependency. [ 904.984637] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.984777] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.985395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.985395] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.985552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.985552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.985736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.985870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.985989] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.287769] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.288152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.288152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.288420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.288543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.288652] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be updated. [ 905.338192] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.338192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.338192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.338365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.338529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.349661] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: IN_PROGRESS for 2s [ 905.488376] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.927090] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: SUCCESS [ 905.927382] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.927586] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.927825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.928085] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.928228] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.928299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.928485] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.928591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.928702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.928880] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.929045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.929162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.929289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.929477] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.929643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.929707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.929848] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.929923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.930035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.930133] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.931275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.931442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.931606] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.931707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.931772] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.931914] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.932797] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.932924] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.994144] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.125555] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 906.125555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.436018] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9: rpc.has_security_group_logging(os_id): False [ 906.436203] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.436377] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.436478] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.436667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.457749] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.457945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.479829] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.480126] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.480271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.480373] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.480638] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.480746] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.480845] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 is going to be updated. [ 906.481958] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.482269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.482552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.482804] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.483048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.483048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.483323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.483323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.483528] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.483631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.483688] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.483949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.483949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.484179] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.484179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.484342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.484342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.488129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.488129] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 is going to be updated. [ 906.496984] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.497229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.497316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.497721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.497886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.498081] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 906.528019] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.528255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.528391] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.528722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.528976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.542042] env[65359]: INFO networking_nsxv3.common.synchronization [req-dd187cbf-5e92-44c4-be3a-f72b5580658d req-4919fafe-110c-4724-a966-99c0350c47e4 tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 with Priority: HIGHEST for action security_group_members [ 906.543316] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: IN_PROGRESS for 2s [ 906.543745] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 with Priority: HIGHEST for action security_group_members [ 906.544186] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.544330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.544454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.546623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.546623] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.546623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.546623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.546623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.546623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.546623] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bbf694f-ad41-4969-a7b8-1248ccdf3fa1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.563244] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.563244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.563497] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.563707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.563924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.584228] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 906.600050] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.600504] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.600581] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.600834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.601035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.623606] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: IN_PROGRESS for 2s [ 906.943041] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.943538] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.943538] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.943616] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.943943] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.944157] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.944279] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.944520] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.944715] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.944956] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.945216] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.945216] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.945325] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.945433] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.945737] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.945875] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.967062] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.967062] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 906.967062] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.967245] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.967595] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-dafb0cd6-f9e2-49bd-895e-e1647e1aa57d taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.967771] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-dafb0cd6-f9e2-49bd-895e-e1647e1aa57d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.967892] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-dafb0cd6-f9e2-49bd-895e-e1647e1aa57d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.968215] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-dafb0cd6-f9e2-49bd-895e-e1647e1aa57d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.968607] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dafb0cd6-f9e2-49bd-895e-e1647e1aa57d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.048989] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.049221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.049221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.049400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.049492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.049696] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.049813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.049875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.050026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.050111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.050171] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 already deleted. [ 907.050296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.360708] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 907.361087] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.361219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.361448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.361694] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.361872] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.361964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.362095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.362170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.362271] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.470948] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.470948] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.470948] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.471459] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.471459] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.471459] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port dafb0cd6-f9e2-49bd-895e-e1647e1aa57d not found, creating... [ 907.471706] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.471858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.471903] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.472133] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.472304] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.472816] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.472816] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.472909] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.473150] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.473235] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.473368] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: dafb0cd6-f9e2-49bd-895e-e1647e1aa57d is going to be created. [ 907.495841] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.496070] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.496222] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.496488] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.496772] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.496996] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-dafb0cd6-f9e2-49bd-895e-e1647e1aa57d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.864387] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.864563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.864657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.864862] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.864959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.865170] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.865278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.865343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.865492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.865572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.865656] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be updated. [ 907.896154] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.896339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.896416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.896685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.896889] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.908287] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: IN_PROGRESS for 2s [ 908.055571] env[65359]: INFO networking_nsxv3.common.synchronization [req-7fe9da99-c6d4-48de-bdf6-ce39a302086a req-3520a851-b44a-456e-82fb-ed3e6f0169b7 tempest-MigrationsAdminTest-860872539 tempest-MigrationsAdminTest-860872539-project-member] Enqueued Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_members [ 908.056241] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGHEST for action security_group_members [ 908.056576] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.056704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.056774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.056976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.057143] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.057244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.057304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.057457] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.057544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.057639] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.222638] env[65359]: INFO networking_nsxv3.common.synchronization [req-dd187cbf-5e92-44c4-be3a-f72b5580658d req-619e2820-48f7-4605-a8f7-0ebaa537f9e0 service nova] Enqueued Resource ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 with Priority: HIGHEST for action security_group_rules [ 908.222638] env[65359]: INFO networking_nsxv3.common.synchronization [req-dd187cbf-5e92-44c4-be3a-f72b5580658d req-619e2820-48f7-4605-a8f7-0ebaa537f9e0 service nova] Enqueued Resource ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 with Priority: HIGHEST for action security_group_members [ 908.222719] env[65359]: INFO networking_nsxv3.common.synchronization [req-dd187cbf-5e92-44c4-be3a-f72b5580658d req-619e2820-48f7-4605-a8f7-0ebaa537f9e0 service nova] Enqueued Resource ID: dafb0cd6-f9e2-49bd-895e-e1647e1aa57d with Priority: HIGHEST for action port [ 908.223019] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 with Priority: HIGHEST for action security_group_rules [ 908.223100] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 with Priority: HIGHEST for action security_group_members [ 908.223137] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafb0cd6-f9e2-49bd-895e-e1647e1aa57d with Priority: HIGHEST for action port [ 908.224102] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.224102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.224102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.232023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.232023] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bbf694f-ad41-4969-a7b8-1248ccdf3fa1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.232023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.232023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.232023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.232023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.232023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.232023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.232023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.232023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.232023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.232023] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bbf694f-ad41-4969-a7b8-1248ccdf3fa1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.232023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-dafb0cd6-f9e2-49bd-895e-e1647e1aa57d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.232519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dafb0cd6-f9e2-49bd-895e-e1647e1aa57d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.232519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dafb0cd6-f9e2-49bd-895e-e1647e1aa57d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.232585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dafb0cd6-f9e2-49bd-895e-e1647e1aa57d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.232670] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dafb0cd6-f9e2-49bd-895e-e1647e1aa57d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.556441] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: SUCCESS [ 908.556671] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 deletion is rescheduled due to dependency. [ 908.556758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.560404] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.560548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.560586] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.560783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.582952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.583227] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.583594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.583594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.583748] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.583835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.583932] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09044820-85da-426b-b103-26678a0652e6 is going to be updated. [ 908.593702] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 908.593991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.594428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.594428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.594632] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.594723] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.594815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.594984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.595085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.595178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.595272] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.614429] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.614937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.614937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.614937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.614937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.632028] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: IN_PROGRESS for 2s [ 908.637618] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 in Status: SUCCESS [ 908.637936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.638136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.638356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.638448] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.735784] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.735784] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.735784] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bbf694f-ad41-4969-a7b8-1248ccdf3fa1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.737032] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dafb0cd6-f9e2-49bd-895e-e1647e1aa57d with status ACTIVE [ 908.737328] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.738486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.738675] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.738918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.739095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.740061] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.740061] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.740061] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.741208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.741411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.741705] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.742351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.742513] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.742954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.743708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.743866] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dafb0cd6-f9e2-49bd-895e-e1647e1aa57d is going to be updated. [ 908.789841] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.790064] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.790064] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.790305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.790508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.790727] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dafb0cd6-f9e2-49bd-895e-e1647e1aa57d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.098052] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.098433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.098433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.098542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.098787] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.098960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.099089] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.099501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.099501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.099501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.099694] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.099817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.099906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.100106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.100311] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.100629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.100744] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.100955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.101108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.101243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.102213] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.161402] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.161574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.161659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.161895] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.161996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.162678] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9 is going to be deleted. [ 909.220392] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.220591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.220697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.221096] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.221269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.221436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76c1ce80-08a8-4def-a5fa-2d70b8a1e8d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.247812] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bbf694f-ad41-4969-a7b8-1248ccdf3fa1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.603865] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6b655ed-9de5-4842-96d3-3652c9e45ddb: rpc.has_security_group_logging(os_id): False [ 909.626023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.626267] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.626267] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.626506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.626598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.626832] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.626995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.626995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.627187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.627284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.627475] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.627742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.627742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.627834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.627881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.628093] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.628190] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.628252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.628423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.628509] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.628584] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 909.705465] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.705647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.705706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.705902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.706056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.719938] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 909.751629] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.751832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.751915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.752149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.752268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.752371] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 is going to be created. [ 909.795345] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.795560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.795560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.795803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.796137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.807399] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 in Status: UNINITIALIZED for 2s [ 909.919655] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153868d0-4b9a-4493-8289-08b4b26dc07b in Status: SUCCESS [ 909.920274] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b deletion is rescheduled due to dependency. [ 909.920602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.646425] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09044820-85da-426b-b103-26678a0652e6 in Status: SUCCESS [ 910.646821] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09044820-85da-426b-b103-26678a0652e6 deletion is rescheduled due to dependency. [ 910.646821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.740667] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 911.740667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.825314] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 in Status: SUCCESS [ 911.826163] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.826437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.826769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.827093] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.827300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.827429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.827906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.828085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.828252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.828416] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bbf694f-ad41-4969-a7b8-1248ccdf3fa1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.334020] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bbf694f-ad41-4969-a7b8-1248ccdf3fa1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.696789] env[65359]: INFO networking_nsxv3.common.synchronization [req-3c749163-ec74-4aa8-a94a-26b801725e2e req-44ee8256-f3fb-4368-81d3-be97439fa62e tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 912.697418] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 912.699658] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.699658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.699658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.699658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.699658] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.699658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.699658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.699658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.699658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.700260] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.836310] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1: rpc.has_security_group_logging(os_id): False [ 912.860217] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.860373] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.860412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.860686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.860785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.861067] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.861198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.861257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.861551] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.861634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.861750] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 is going to be created. [ 912.944040] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.944040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.944040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.944040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.944040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.957071] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 in Status: IN_PROGRESS for 2s [ 913.202733] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.209346] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-970 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.209546] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.209678] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.209966] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.210244] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.210407] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.210526] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.210750] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.210899] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.211124] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.211319] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.211368] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.211449] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.211555] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.211659] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.211894] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.234150] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.234383] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 913.234534] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.234786] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-970" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.235168] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-a7a819c9-ea3e-402c-a174-de9ab3b8defd taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.235350] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.235472] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.235791] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.235935] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7a819c9-ea3e-402c-a174-de9ab3b8defd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.705352] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.739283] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.739720] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.739905] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.740224] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.740451] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.740646] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port a7a819c9-ea3e-402c-a174-de9ab3b8defd not found, creating... [ 913.741035] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.741249] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.741399] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.741673] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.741822] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.742143] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.742441] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.742652] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.742977] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.743161] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.743326] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: a7a819c9-ea3e-402c-a174-de9ab3b8defd is going to be created. [ 913.764682] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.765169] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.765217] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.765566] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.765889] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.766256] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.211935] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.211935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.211935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.211935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.211935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.211935] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 914.245997] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.247735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.247735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.247735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.247735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.259122] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 914.533742] env[65359]: INFO networking_nsxv3.common.synchronization [req-3c749163-ec74-4aa8-a94a-26b801725e2e req-c1f80d6a-f800-490e-8cb0-bfa1f183bf85 service nova] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_rules [ 914.533742] env[65359]: INFO networking_nsxv3.common.synchronization [req-3c749163-ec74-4aa8-a94a-26b801725e2e req-c1f80d6a-f800-490e-8cb0-bfa1f183bf85 service nova] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 914.534273] env[65359]: INFO networking_nsxv3.common.synchronization [req-3c749163-ec74-4aa8-a94a-26b801725e2e req-c1f80d6a-f800-490e-8cb0-bfa1f183bf85 service nova] Enqueued Resource ID: a7a819c9-ea3e-402c-a174-de9ab3b8defd with Priority: HIGHEST for action port [ 914.535440] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_rules [ 914.535772] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 914.535932] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7a819c9-ea3e-402c-a174-de9ab3b8defd with Priority: HIGHEST for action port [ 914.536533] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.536533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.536729] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.536918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.537047] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.538622] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.538779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.539077] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7a819c9-ea3e-402c-a174-de9ab3b8defd taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.539260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.539367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.539599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.539728] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7a819c9-ea3e-402c-a174-de9ab3b8defd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.970224] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 in Status: SUCCESS [ 914.970595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.042119] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.042278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.042572] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7a819c9-ea3e-402c-a174-de9ab3b8defd with status ACTIVE [ 915.042762] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.042877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.042939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.043178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.043320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.043532] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.043667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.043747] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.043898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.044030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.044744] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.044917] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.044961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.045143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.045219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.045325] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7a819c9-ea3e-402c-a174-de9ab3b8defd is going to be updated. [ 915.069920] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.070090] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.070157] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.070381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.070528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.070698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.273317] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 916.273739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.273778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.274774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.274774] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.274774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.274774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.275108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.275108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.275206] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.777469] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.282329] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.423977] env[65359]: INFO networking_nsxv3.common.synchronization [req-a9e94f78-93d8-4975-8b16-7ba16766c6e3 req-e3e114d0-28ea-4b0f-84ad-8c079b692d35 tempest-ImagesTestJSON-1497561183 tempest-ImagesTestJSON-1497561183-project-member] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 917.424681] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 917.425280] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.425464] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.425684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.425906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.426149] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.426303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.426391] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.426636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.426785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.426977] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.751631] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-189 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.751891] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.751998] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.752762] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.753235] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.754042] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.754042] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.754042] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.754042] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.754242] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.754325] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.754422] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.754585] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.754693] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.754800] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.754890] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.777867] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.778058] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 917.778202] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.778381] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.778692] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-0af3792b-116a-4d9c-92e6-e69deeca52e4 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.778865] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-0af3792b-116a-4d9c-92e6-e69deeca52e4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.778983] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-0af3792b-116a-4d9c-92e6-e69deeca52e4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.779352] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-0af3792b-116a-4d9c-92e6-e69deeca52e4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.779491] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0af3792b-116a-4d9c-92e6-e69deeca52e4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.785977] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.785977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.785977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.786222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.786222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.786222] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 917.817970] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.818191] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.818191] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.820030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.820030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.829494] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 917.931580] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.281616] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.281961] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.282071] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.282439] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.282852] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.282852] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 0af3792b-116a-4d9c-92e6-e69deeca52e4 not found, creating... [ 918.283082] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.283354] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.283354] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.283612] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.283748] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.284465] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.284465] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.284465] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.284661] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.284778] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.284884] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 0af3792b-116a-4d9c-92e6-e69deeca52e4 is going to be created. [ 918.307555] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.307784] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.307909] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.308218] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.308451] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.308681] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-0af3792b-116a-4d9c-92e6-e69deeca52e4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.433299] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.935794] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.935903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.935978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.936204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.936301] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.936400] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 918.974095] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.974467] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.974467] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.974647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.974786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.985263] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 919.033832] env[65359]: INFO networking_nsxv3.common.synchronization [req-a9e94f78-93d8-4975-8b16-7ba16766c6e3 req-85d6960f-2f0c-425d-8259-45eb1ad087b4 service nova] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_rules [ 919.034020] env[65359]: INFO networking_nsxv3.common.synchronization [req-a9e94f78-93d8-4975-8b16-7ba16766c6e3 req-85d6960f-2f0c-425d-8259-45eb1ad087b4 service nova] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 919.034162] env[65359]: INFO networking_nsxv3.common.synchronization [req-a9e94f78-93d8-4975-8b16-7ba16766c6e3 req-85d6960f-2f0c-425d-8259-45eb1ad087b4 service nova] Enqueued Resource ID: 0af3792b-116a-4d9c-92e6-e69deeca52e4 with Priority: HIGHEST for action port [ 919.034660] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_rules [ 919.034794] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 919.035228] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af3792b-116a-4d9c-92e6-e69deeca52e4 with Priority: HIGHEST for action port [ 919.035557] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.035686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.035752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.035955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.036052] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.037632] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.037740] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.037939] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-0af3792b-116a-4d9c-92e6-e69deeca52e4 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.038059] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0af3792b-116a-4d9c-92e6-e69deeca52e4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.038125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0af3792b-116a-4d9c-92e6-e69deeca52e4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.038304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0af3792b-116a-4d9c-92e6-e69deeca52e4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.038368] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0af3792b-116a-4d9c-92e6-e69deeca52e4',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.537933] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.538342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.540795] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0af3792b-116a-4d9c-92e6-e69deeca52e4 with status ACTIVE [ 919.541341] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.541776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.542052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.542437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.542658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.542973] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.543200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.543392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.543525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.543748] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.544050] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.544182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.544228] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.544471] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.544557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.544631] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0af3792b-116a-4d9c-92e6-e69deeca52e4 is going to be updated. [ 919.573365] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.573580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.573580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.573882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.574036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.574319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0af3792b-116a-4d9c-92e6-e69deeca52e4" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.842940] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 919.843332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.843719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.843793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.844012] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.844176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.844273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.844465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.844567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.844674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.844770] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.348463] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.348631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.348705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.348927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.349092] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.350300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.350300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.350300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.350300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.350300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.350300] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.350300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.350300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.350300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.350300] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.350300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.350300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.350943] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.350943] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.350943] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.350943] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.780140] env[65359]: INFO networking_nsxv3.common.synchronization [None req-12d9cde8-c3b6-4012-953b-f060ec1d857b tempest-ServerDiskConfigTestJSON-2085995032 tempest-ServerDiskConfigTestJSON-2085995032-project-member] Enqueued Resource ID: cc9ec164-c4a5-4641-a0b2-73fade268115 with Priority: HIGHEST for action security_group_rules [ 920.780846] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc9ec164-c4a5-4641-a0b2-73fade268115 with Priority: HIGHEST for action security_group_rules [ 920.781192] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc9ec164-c4a5-4641-a0b2-73fade268115 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.781310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc9ec164-c4a5-4641-a0b2-73fade268115" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.781363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc9ec164-c4a5-4641-a0b2-73fade268115" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.781685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc9ec164-c4a5-4641-a0b2-73fade268115" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.781772] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc9ec164-c4a5-4641-a0b2-73fade268115',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.857847] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6: rpc.has_security_group_logging(os_id): False [ 920.869827] env[65359]: INFO networking_nsxv3.common.synchronization [None req-1453c443-2d3f-4d75-83db-e1947dfa324a tempest-ServerDiskConfigTestJSON-2085995032 tempest-ServerDiskConfigTestJSON-2085995032-project-member] Enqueued Resource ID: cc9ec164-c4a5-4641-a0b2-73fade268115 with Priority: HIGHEST for action security_group_rules [ 920.870600] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc9ec164-c4a5-4641-a0b2-73fade268115 with Priority: HIGHEST for action security_group_rules [ 920.871061] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc9ec164-c4a5-4641-a0b2-73fade268115 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.871238] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc9ec164-c4a5-4641-a0b2-73fade268115" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.880222] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.880389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.880536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.880765] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.903675] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.903929] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.904112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.904226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.904393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.904479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.905079] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.905079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.905079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.905079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.905079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.905340] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.905340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.905421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.905531] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.905606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.905688] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 920.983300] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.983552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.983552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.983949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.983949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.999346] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 920.999607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.999806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.000053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.000384] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.001019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.001019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.001019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.001187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.001187] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.022944] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 921.308789] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.308789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.308789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.309256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.309444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.310279] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc9ec164-c4a5-4641-a0b2-73fade268115 already deleted. [ 921.310279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc9ec164-c4a5-4641-a0b2-73fade268115" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.310279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc9ec164-c4a5-4641-a0b2-73fade268115" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.310464] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc9ec164-c4a5-4641-a0b2-73fade268115" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.311033] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc9ec164-c4a5-4641-a0b2-73fade268115',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.504203] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.833661] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.833942] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.833942] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.834239] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.834239] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.834348] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc9ec164-c4a5-4641-a0b2-73fade268115 already deleted. [ 921.834497] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc9ec164-c4a5-4641-a0b2-73fade268115" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.006614] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.512118] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.514412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.514412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.514412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.514412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.514412] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 922.553701] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.553916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.554056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.554362] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.554596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.567687] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 923.042703] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 923.042958] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.579990] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 924.580300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.580503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.580740] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.580996] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.581174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.581266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.581500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.581811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.581811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.581921] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.869597] env[65359]: INFO networking_nsxv3.common.synchronization [req-cdd09261-d762-4961-ab7d-d89d2918a426 req-4a4ae830-5883-410f-9430-0204676651cd tempest-ServerDiskConfigTestJSON-2085995032 tempest-ServerDiskConfigTestJSON-2085995032-project-member] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 924.869597] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 924.871070] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.871578] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.871789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.874530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.874530] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.874530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.874530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.874530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.874530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.874530] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.085319] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.087955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.087955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.087955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.087955] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.087955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.087955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.087955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.087955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.087955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.088466] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.088466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.088466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.088566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.088834] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.088999] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.089093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.089492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.089492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.089492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.089625] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.363308] env[65359]: INFO networking_nsxv3.common.synchronization [req-da863b29-3450-4a66-bbd7-f11c718c606b req-314ffde4-e2fc-4c13-8c1a-4e19cf4406c8 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGHEST for action security_group_members [ 925.363563] env[65359]: INFO networking_nsxv3.common.synchronization [req-da863b29-3450-4a66-bbd7-f11c718c606b req-314ffde4-e2fc-4c13-8c1a-4e19cf4406c8 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 925.364500] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGHEST for action security_group_members [ 925.364662] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 925.365224] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac4b252c-75eb-46d7-adb1-3c832626f301 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.365224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.365224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.365571] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.366357] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.366485] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.366555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.366894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.366894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.367052] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.368287] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.369187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.369245] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.369412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.369699] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.369699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.369842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.370418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.370418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.370418] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.376537] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.376687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.376800] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.376972] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.403708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.403909] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.404093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.404172] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.404453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.404559] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.404706] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be updated. [ 925.428879] env[65359]: INFO networking_nsxv3.common.synchronization [req-da863b29-3450-4a66-bbd7-f11c718c606b req-314ffde4-e2fc-4c13-8c1a-4e19cf4406c8 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_rules [ 925.429147] env[65359]: INFO networking_nsxv3.common.synchronization [req-da863b29-3450-4a66-bbd7-f11c718c606b req-314ffde4-e2fc-4c13-8c1a-4e19cf4406c8 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 925.429296] env[65359]: INFO networking_nsxv3.common.synchronization [req-da863b29-3450-4a66-bbd7-f11c718c606b req-314ffde4-e2fc-4c13-8c1a-4e19cf4406c8 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGHEST for action security_group_rules [ 925.429424] env[65359]: INFO networking_nsxv3.common.synchronization [req-da863b29-3450-4a66-bbd7-f11c718c606b req-314ffde4-e2fc-4c13-8c1a-4e19cf4406c8 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGHEST for action security_group_members [ 925.429554] env[65359]: INFO networking_nsxv3.common.synchronization [req-da863b29-3450-4a66-bbd7-f11c718c606b req-314ffde4-e2fc-4c13-8c1a-4e19cf4406c8 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: a7a819c9-ea3e-402c-a174-de9ab3b8defd with Priority: HIGHEST for action port [ 925.430159] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_rules [ 925.430305] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGHEST for action security_group_rules [ 925.430418] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7a819c9-ea3e-402c-a174-de9ab3b8defd with Priority: HIGHEST for action port [ 925.430562] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 925.430738] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGHEST for action security_group_members [ 925.431564] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.431720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.431805] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.432081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.432179] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.435266] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac4b252c-75eb-46d7-adb1-3c832626f301 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.435403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.435443] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.436589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.436716] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.437730] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7a819c9-ea3e-402c-a174-de9ab3b8defd taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.437874] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.437993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.438177] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.438259] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7a819c9-ea3e-402c-a174-de9ab3b8defd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.439765] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.439869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.440089] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac4b252c-75eb-46d7-adb1-3c832626f301 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.440181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.443366] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.443541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.443541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.443785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.443948] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.458364] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: IN_PROGRESS for 2s [ 925.596042] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28737c44-388f-4cb8-9cac-0181cbb28981: rpc.has_security_group_logging(os_id): False [ 925.625240] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.625386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.625459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.625857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.648668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.649167] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.650927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.650927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.650927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.650927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.650927] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.651319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.651319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.651319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.651319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.651477] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.653046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.653046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.653046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.653046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.653046] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 925.748338] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.748493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.748642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.748786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.748937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.767518] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 925.872222] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.874858] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.935570] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.936509] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.941169] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7a819c9-ea3e-402c-a174-de9ab3b8defd with status ACTIVE [ 925.941780] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.941962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.942037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.942329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.942477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.942802] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.942915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.943303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.943303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.943303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.943473] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.943575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.943647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.943905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.943986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.947360] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7a819c9-ea3e-402c-a174-de9ab3b8defd is going to be updated. [ 925.950445] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac4b252c-75eb-46d7-adb1-3c832626f301 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.950445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.973644] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.973644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.974530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.974530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.974530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.974530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.376133] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.383499] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.887857] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.888183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.888183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.888430] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.888522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.888636] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 926.890086] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.890215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.890280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.890466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.890642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.890744] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac4b252c-75eb-46d7-adb1-3c832626f301 is going to be created. [ 926.950034] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.950034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.950034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.950359] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.950867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.953273] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.953405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.953502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.953833] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.954057] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.968170] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 926.978969] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac4b252c-75eb-46d7-adb1-3c832626f301 in Status: UNINITIALIZED for 2s [ 927.473520] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 927.473692] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b deletion is rescheduled due to dependency. [ 927.473748] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.799597] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 927.799771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.985117] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 928.985518] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.985593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.985904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.986143] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.986310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.986462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.987110] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.987241] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.987370] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.989071] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac4b252c-75eb-46d7-adb1-3c832626f301 in Status: SUCCESS [ 928.989304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.989554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.989850] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.990122] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.990424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.990537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.990779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.990852] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.990989] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.493384] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.494651] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.587708] env[65359]: INFO networking_nsxv3.common.synchronization [req-efdd618a-0eb7-435f-998d-b5308b389e5d req-87b96c22-e3b2-4d68-9b92-532b14d68494 tempest-ServersTestManualDisk-1454548057 tempest-ServersTestManualDisk-1454548057-project-member] Enqueued Resource ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 with Priority: HIGHEST for action security_group_members [ 929.588403] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 with Priority: HIGHEST for action security_group_members [ 929.588738] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.589236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.589336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.589567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.590047] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.590177] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.590229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.590718] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.590863] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.590995] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3711d124-9bf8-4fa4-9c53-ee6c21e9b344',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.997582] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.998666] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.048779] env[65359]: INFO networking_nsxv3.common.synchronization [None req-a4a3d70e-2843-42a7-955e-58846787372b None None] Enqueued Resource ID: 11deaf50-0ee4-4b9c-8777-a23d04eb22b7 with Priority: HIGHEST for action port [ 930.048951] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11deaf50-0ee4-4b9c-8777-a23d04eb22b7 with Priority: HIGHEST for action port [ 930.052263] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-11deaf50-0ee4-4b9c-8777-a23d04eb22b7 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.053066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11deaf50-0ee4-4b9c-8777-a23d04eb22b7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.053214] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11deaf50-0ee4-4b9c-8777-a23d04eb22b7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.053508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11deaf50-0ee4-4b9c-8777-a23d04eb22b7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.053598] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11deaf50-0ee4-4b9c-8777-a23d04eb22b7',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.094221] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.095104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.095104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.095104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.120735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.120735] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.120735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.120735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.120735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.120735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.120735] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 is going to be updated. [ 930.157738] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.157911] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.157985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.158285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.158492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.174990] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 in Status: IN_PROGRESS for 2s [ 930.503891] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.506297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.506297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.506297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.506297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.506297] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 930.506690] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.506831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.507179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.507179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.507179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.507341] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac4b252c-75eb-46d7-adb1-3c832626f301 is going to be updated. [ 930.543326] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.543566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.543647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.543876] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.544128] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.546455] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.546590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.546660] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.546937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.547016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.556380] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11deaf50-0ee4-4b9c-8777-a23d04eb22b7 [ 930.556565] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.556718] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.556811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.557595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.557595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.557595] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11deaf50-0ee4-4b9c-8777-a23d04eb22b7 already deleted. [ 930.557595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11deaf50-0ee4-4b9c-8777-a23d04eb22b7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.561895] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 930.564255] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac4b252c-75eb-46d7-adb1-3c832626f301 in Status: IN_PROGRESS for 2s [ 930.708396] env[65359]: INFO networking_nsxv3.common.synchronization [req-dafb750b-facd-4e4b-889c-ee1b43d1672c req-dda9e781-0954-4011-a162-4e14f0af39fc tempest-ServerRescueNegativeTestJSON-174363340 tempest-ServerRescueNegativeTestJSON-174363340-project-member] Enqueued Resource ID: c5b458df-8f8e-47b7-9e32-899c590c5940 with Priority: HIGHEST for action security_group_members [ 930.709043] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b458df-8f8e-47b7-9e32-899c590c5940 with Priority: HIGHEST for action security_group_members [ 930.709825] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5b458df-8f8e-47b7-9e32-899c590c5940 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.714336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.714487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.714804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.715064] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.715182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.715245] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.715440] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.715525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.715629] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5b458df-8f8e-47b7-9e32-899c590c5940',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.107615] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.108074] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-624" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.108074] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-624" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.108366] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-624" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.108992] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.109822] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.111470] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.111761] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.111930] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.112253] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.112376] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.112495] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.114871] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.114871] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.114871] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.114871] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.138197] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.138298] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 931.138377] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.139170] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-624" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.139170] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-857a777a-66a4-4621-a954-0f3bbe68e314 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.139903] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-857a777a-66a4-4621-a954-0f3bbe68e314" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.140199] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-857a777a-66a4-4621-a954-0f3bbe68e314" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.140571] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-857a777a-66a4-4621-a954-0f3bbe68e314" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.140717] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('857a777a-66a4-4621-a954-0f3bbe68e314',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.220959] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.221146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.221336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.223261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.223261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.223261] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.223261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.223261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.223261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.223261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.223261] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5b458df-8f8e-47b7-9e32-899c590c5940 already deleted. [ 931.223261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.645667] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.645667] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.645850] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.646069] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.647276] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.647562] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 857a777a-66a4-4621-a954-0f3bbe68e314 not found, creating... [ 931.649026] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.649026] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.649026] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.649026] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.649026] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.649026] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.649460] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.649700] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.649975] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.650238] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.650461] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 857a777a-66a4-4621-a954-0f3bbe68e314 is going to be created. [ 931.674712] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.674943] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.676059] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.676059] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.676059] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.676059] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-857a777a-66a4-4621-a954-0f3bbe68e314" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.187614] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 in Status: SUCCESS [ 932.188018] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 deletion is rescheduled due to dependency. [ 932.188018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.437348] env[65359]: INFO networking_nsxv3.common.synchronization [req-dafb750b-facd-4e4b-889c-ee1b43d1672c req-fe07c73e-7fb6-4051-ab36-af2338a29ace service nova] Enqueued Resource ID: c5b458df-8f8e-47b7-9e32-899c590c5940 with Priority: HIGHEST for action security_group_rules [ 932.437348] env[65359]: INFO networking_nsxv3.common.synchronization [req-dafb750b-facd-4e4b-889c-ee1b43d1672c req-fe07c73e-7fb6-4051-ab36-af2338a29ace service nova] Enqueued Resource ID: c5b458df-8f8e-47b7-9e32-899c590c5940 with Priority: HIGHEST for action security_group_members [ 932.437348] env[65359]: INFO networking_nsxv3.common.synchronization [req-dafb750b-facd-4e4b-889c-ee1b43d1672c req-fe07c73e-7fb6-4051-ab36-af2338a29ace service nova] Enqueued Resource ID: 857a777a-66a4-4621-a954-0f3bbe68e314 with Priority: HIGHEST for action port [ 932.438030] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b458df-8f8e-47b7-9e32-899c590c5940 with Priority: HIGHEST for action security_group_rules [ 932.438030] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b458df-8f8e-47b7-9e32-899c590c5940 with Priority: HIGHEST for action security_group_members [ 932.438220] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857a777a-66a4-4621-a954-0f3bbe68e314 with Priority: HIGHEST for action port [ 932.438572] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5b458df-8f8e-47b7-9e32-899c590c5940 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.438774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.438867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.439123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.439631] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5b458df-8f8e-47b7-9e32-899c590c5940',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.440270] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5b458df-8f8e-47b7-9e32-899c590c5940 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.440447] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.440501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.440791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.441023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.441407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.441407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.441407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.441611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.441611] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5b458df-8f8e-47b7-9e32-899c590c5940',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.443160] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-857a777a-66a4-4621-a954-0f3bbe68e314 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.443160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-857a777a-66a4-4621-a954-0f3bbe68e314" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.443160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-857a777a-66a4-4621-a954-0f3bbe68e314" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.443160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-857a777a-66a4-4621-a954-0f3bbe68e314" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.443160] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('857a777a-66a4-4621-a954-0f3bbe68e314',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.575365] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac4b252c-75eb-46d7-adb1-3c832626f301 in Status: SUCCESS [ 932.575605] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.576495] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 932.576781] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.577395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.577720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.577903] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.578104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.578203] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.578449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.578593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.578713] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.578985] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.580883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.581138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.581359] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.581593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.581778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.581972] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.582108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.582236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.582307] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.893460] env[65359]: INFO networking_nsxv3.common.synchronization [None req-a2ac56d2-28db-4e24-8b6d-9f1e4de742ed None None] Enqueued Resource ID: e5c374d4-577d-4ec8-9493-69a322520061 with Priority: HIGHEST for action port [ 932.893750] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5c374d4-577d-4ec8-9493-69a322520061 with Priority: HIGHEST for action port [ 932.894157] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5c374d4-577d-4ec8-9493-69a322520061 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.894277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5c374d4-577d-4ec8-9493-69a322520061" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.894343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5c374d4-577d-4ec8-9493-69a322520061" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.894605] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5c374d4-577d-4ec8-9493-69a322520061" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.894693] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5c374d4-577d-4ec8-9493-69a322520061',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.945714] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5b458df-8f8e-47b7-9e32-899c590c5940 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.945714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.945714] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5b458df-8f8e-47b7-9e32-899c590c5940',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.947491] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 857a777a-66a4-4621-a954-0f3bbe68e314 with status ACTIVE [ 932.947491] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.947491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.947491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.947491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.947491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.947907] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.947907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.947907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.948512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.948512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.948512] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.948512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.948839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.948839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.948839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.948982] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 857a777a-66a4-4621-a954-0f3bbe68e314 is going to be updated. [ 932.952431] env[65359]: INFO networking_nsxv3.common.synchronization [req-e8a8b3ca-bca5-4ba0-b069-1b006f5331f1 req-4a4e2da3-3786-4c94-8793-af6e0367699f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGHEST for action security_group_members [ 932.952431] env[65359]: INFO networking_nsxv3.common.synchronization [req-e8a8b3ca-bca5-4ba0-b069-1b006f5331f1 req-4a4e2da3-3786-4c94-8793-af6e0367699f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 932.952626] env[65359]: INFO networking_nsxv3.common.synchronization [req-e8a8b3ca-bca5-4ba0-b069-1b006f5331f1 req-4a4e2da3-3786-4c94-8793-af6e0367699f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 with Priority: HIGHEST for action security_group_members [ 932.953471] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGHEST for action security_group_members [ 932.953631] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 932.953732] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 with Priority: HIGHEST for action security_group_members [ 932.954069] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac4b252c-75eb-46d7-adb1-3c832626f301 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.954176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.954176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.954522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.954766] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.954980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.955215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.955340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.955400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.955517] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.956924] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.957110] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.957307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.957508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.957731] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.957829] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.957883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.959478] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.959478] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.959478] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.961217] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-12061c22-6f53-4a32-9e09-aacd3a271bb1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.961217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.961217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.961217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.961217] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.961217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.961217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.961217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.961217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.961706] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12061c22-6f53-4a32-9e09-aacd3a271bb1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.975018] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.975229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.975283] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.975493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.975933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.976285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-857a777a-66a4-4621-a954-0f3bbe68e314" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.010357] env[65359]: INFO networking_nsxv3.common.synchronization [req-e8a8b3ca-bca5-4ba0-b069-1b006f5331f1 req-4a4e2da3-3786-4c94-8793-af6e0367699f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 with Priority: HIGHEST for action security_group_rules [ 933.010357] env[65359]: INFO networking_nsxv3.common.synchronization [req-e8a8b3ca-bca5-4ba0-b069-1b006f5331f1 req-4a4e2da3-3786-4c94-8793-af6e0367699f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 with Priority: HIGHEST for action security_group_members [ 933.010357] env[65359]: INFO networking_nsxv3.common.synchronization [req-e8a8b3ca-bca5-4ba0-b069-1b006f5331f1 req-4a4e2da3-3786-4c94-8793-af6e0367699f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_rules [ 933.010645] env[65359]: INFO networking_nsxv3.common.synchronization [req-e8a8b3ca-bca5-4ba0-b069-1b006f5331f1 req-4a4e2da3-3786-4c94-8793-af6e0367699f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 933.010645] env[65359]: INFO networking_nsxv3.common.synchronization [req-e8a8b3ca-bca5-4ba0-b069-1b006f5331f1 req-4a4e2da3-3786-4c94-8793-af6e0367699f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGHEST for action security_group_rules [ 933.010737] env[65359]: INFO networking_nsxv3.common.synchronization [req-e8a8b3ca-bca5-4ba0-b069-1b006f5331f1 req-4a4e2da3-3786-4c94-8793-af6e0367699f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGHEST for action security_group_members [ 933.011080] env[65359]: INFO networking_nsxv3.common.synchronization [req-e8a8b3ca-bca5-4ba0-b069-1b006f5331f1 req-4a4e2da3-3786-4c94-8793-af6e0367699f tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: a7a819c9-ea3e-402c-a174-de9ab3b8defd with Priority: HIGHEST for action port [ 933.011909] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 with Priority: HIGHEST for action security_group_rules [ 933.011909] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_rules [ 933.012196] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGHEST for action security_group_members [ 933.012196] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7a819c9-ea3e-402c-a174-de9ab3b8defd with Priority: HIGHEST for action port [ 933.012281] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGHEST for action security_group_rules [ 933.012462] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 with Priority: HIGHEST for action security_group_members [ 933.012537] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 933.013146] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12061c22-6f53-4a32-9e09-aacd3a271bb1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.013326] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.013433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.016391] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.016946] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12061c22-6f53-4a32-9e09-aacd3a271bb1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.017673] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.017673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.017764] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac4b252c-75eb-46d7-adb1-3c832626f301 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.017764] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.020486] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7a819c9-ea3e-402c-a174-de9ab3b8defd taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.021995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.022123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.022525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.022612] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7a819c9-ea3e-402c-a174-de9ab3b8defd',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.023540] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac4b252c-75eb-46d7-adb1-3c832626f301 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.023702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.023930] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-12061c22-6f53-4a32-9e09-aacd3a271bb1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.024071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.024219] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.024571] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.081676] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.085162] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.085638] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.398056] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5c374d4-577d-4ec8-9493-69a322520061 [ 933.398318] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.398485] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.398598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.398858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.399108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.399209] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5c374d4-577d-4ec8-9493-69a322520061 already deleted. [ 933.399324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5c374d4-577d-4ec8-9493-69a322520061" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.451852] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5b458df-8f8e-47b7-9e32-899c590c5940',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.463534] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.464267] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.466074] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12061c22-6f53-4a32-9e09-aacd3a271bb1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.525660] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-12061c22-6f53-4a32-9e09-aacd3a271bb1 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.525807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.526063] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7a819c9-ea3e-402c-a174-de9ab3b8defd with status ACTIVE [ 933.526287] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.526399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.526461] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.526672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.526763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.526932] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.527038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.527099] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.527418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.527506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.527817] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.527817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.527817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.528236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.528236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.528236] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7a819c9-ea3e-402c-a174-de9ab3b8defd is going to be updated. [ 933.554563] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.554751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.554881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.555355] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.555527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.555683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7a819c9-ea3e-402c-a174-de9ab3b8defd" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.585330] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac4b252c-75eb-46d7-adb1-3c832626f301: rpc.has_security_group_logging(os_id): False [ 933.603905] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.603905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.604239] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.604948] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.605520] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.605805] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.605898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.605950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.606253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.606336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.606388] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac4b252c-75eb-46d7-adb1-3c832626f301 is going to be created. [ 933.692043] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.692215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.692263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.692475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.692655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.706522] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac4b252c-75eb-46d7-adb1-3c832626f301 in Status: IN_PROGRESS for 2s [ 933.954532] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.954729] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.954798] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.954977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.955084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.955201] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5b458df-8f8e-47b7-9e32-899c590c5940 is going to be created. [ 933.968022] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.968978] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.969932] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12061c22-6f53-4a32-9e09-aacd3a271bb1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.981021] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.981162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.981162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.981338] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.981478] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.991373] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b458df-8f8e-47b7-9e32-899c590c5940 in Status: UNINITIALIZED for 2s [ 934.471572] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.471572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.471572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.471572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.472104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.472104] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac4b252c-75eb-46d7-adb1-3c832626f301 is going to be updated. [ 934.473277] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.473411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.473480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.473655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.473741] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.473830] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 934.475325] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.475514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.475573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.475924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.476085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.476178] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 is going to be created. [ 934.512521] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.512719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.512804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.513082] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.513259] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.515913] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.516085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.516173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.516382] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.516543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.518282] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.518406] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.518474] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.518656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.518795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.529647] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 in Status: UNINITIALIZED for 2s [ 934.529647] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac4b252c-75eb-46d7-adb1-3c832626f301 in Status: IN_PROGRESS for 2s [ 934.529647] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 935.719127] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac4b252c-75eb-46d7-adb1-3c832626f301 in Status: SUCCESS [ 935.719397] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.719527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.719752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.719849] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.005838] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b458df-8f8e-47b7-9e32-899c590c5940 in Status: SUCCESS [ 936.005838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.006073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.006986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.006986] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.006986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.006986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.006986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.007717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.007717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.007717] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5b458df-8f8e-47b7-9e32-899c590c5940',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.223131] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac4b252c-75eb-46d7-adb1-3c832626f301 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.223131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.512572] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5b458df-8f8e-47b7-9e32-899c590c5940',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.545025] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 936.545025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.545025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.545025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.545025] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.545025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.545025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.545025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.545025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.545611] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.547791] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 in Status: SUCCESS [ 936.548866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.551605] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac4b252c-75eb-46d7-adb1-3c832626f301 in Status: SUCCESS [ 936.552074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.552393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.556036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.556036] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.556036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.556036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.556036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.556036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.556036] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12061c22-6f53-4a32-9e09-aacd3a271bb1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.556036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.556036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.556036] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.563040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.563040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.563040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.563040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.563040] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.921558] env[65359]: INFO networking_nsxv3.common.synchronization [req-ab70da44-2b2c-4c2e-8094-bf66612bebb7 req-e09efe5a-c3cf-4772-ac35-e15d7c54a390 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGHEST for action security_group_members [ 936.921876] env[65359]: INFO networking_nsxv3.common.synchronization [req-ab70da44-2b2c-4c2e-8094-bf66612bebb7 req-e09efe5a-c3cf-4772-ac35-e15d7c54a390 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 936.921876] env[65359]: INFO networking_nsxv3.common.synchronization [req-ab70da44-2b2c-4c2e-8094-bf66612bebb7 req-e09efe5a-c3cf-4772-ac35-e15d7c54a390 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 with Priority: HIGHEST for action security_group_members [ 936.923505] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGHEST for action security_group_members [ 936.923723] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 936.923858] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 with Priority: HIGHEST for action security_group_members [ 936.924421] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac4b252c-75eb-46d7-adb1-3c832626f301 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.924501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.924752] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.924878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.925582] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-12061c22-6f53-4a32-9e09-aacd3a271bb1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.925758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.017379] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5b458df-8f8e-47b7-9e32-899c590c5940: rpc.has_security_group_logging(os_id): False [ 937.037309] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.037499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.037542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.037788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.037926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.038232] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.038360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.038427] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.038624] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.038674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.038765] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5b458df-8f8e-47b7-9e32-899c590c5940 is going to be created. [ 937.063433] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12061c22-6f53-4a32-9e09-aacd3a271bb1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.065232] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.066611] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.134773] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.134965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.135094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.135505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.135749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.149453] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5b458df-8f8e-47b7-9e32-899c590c5940 in Status: IN_PROGRESS for 2s [ 937.449602] env[65359]: INFO networking_nsxv3.common.synchronization [req-4e8ebb80-0ecc-474c-bd8f-3fbbfc092917 req-75d7e807-4139-4b4e-b7ee-42ffa7903792 tempest-ImagesTestJSON-1497561183 tempest-ImagesTestJSON-1497561183-project-member] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 937.450208] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 937.450596] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.450736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.450804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.451294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.451461] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.451567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.451631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.451831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.453116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.453116] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.566515] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12061c22-6f53-4a32-9e09-aacd3a271bb1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.568847] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.569538] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.957359] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.071525] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.071878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.072073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.072369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.072559] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.073063] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 938.074396] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.074647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.074792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.075049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.075219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.075377] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 is going to be updated. [ 938.076510] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.077128] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.077293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.077534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.077693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.079016] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac4b252c-75eb-46d7-adb1-3c832626f301 is going to be updated. [ 938.111250] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.111444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.111607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.111885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.112129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.113967] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.114278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.114381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.114983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.114983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.116771] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.116958] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.117541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.117541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.117541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.129710] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 in Status: IN_PROGRESS for 2s [ 938.130633] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac4b252c-75eb-46d7-adb1-3c832626f301 in Status: IN_PROGRESS for 2s [ 938.131278] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 938.458443] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.635539] env[65359]: INFO networking_nsxv3.common.synchronization [req-46033f61-443c-4626-a427-564c14b59f8c req-3d65d396-e215-4a18-9b6c-f509448a1e90 tempest-ServersTestBootFromVolume-259238566 tempest-ServersTestBootFromVolume-259238566-project-member] Enqueued Resource ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d with Priority: HIGHEST for action security_group_members [ 938.640211] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d with Priority: HIGHEST for action security_group_members [ 938.640852] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a269c68-1fd7-4085-a1d3-54f407762a6d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.640971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.641049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.641307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.641470] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.641567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.642614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.642614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.642614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.642614] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a269c68-1fd7-4085-a1d3-54f407762a6d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.962093] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.962093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.962093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.962093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.962590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.962590] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 938.994619] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.994900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.994900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.995255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.995380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.006585] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 939.144858] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.145287] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.145287] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.145567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.145567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.145699] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.145785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.145839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.145991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.146086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.146173] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d already deleted. [ 939.146420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.160977] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5b458df-8f8e-47b7-9e32-899c590c5940 in Status: SUCCESS [ 939.161166] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.911833] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-468 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.912046] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-468" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.912174] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-468" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.912514] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-468" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.912865] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.913120] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.913271] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.913494] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.913708] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.913954] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 939.914077] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.914183] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.914303] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.914412] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 939.914574] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.914777] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 939.938080] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 939.938260] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 939.938898] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 939.938898] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-468" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.938898] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.939122] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.939156] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.939789] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.939789] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.142698] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 in Status: SUCCESS [ 940.143072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.143162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.143364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.143568] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.143688] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.143749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.143908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.144049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.144100] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.144175] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12061c22-6f53-4a32-9e09-aacd3a271bb1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.145596] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac4b252c-75eb-46d7-adb1-3c832626f301 in Status: SUCCESS [ 940.145907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.146604] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 940.146604] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.146707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.147013] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.147013] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.147132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.147132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.147263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.147352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.147424] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12061c22-6f53-4a32-9e09-aacd3a271bb1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.148191] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.148357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.148514] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.148614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.148679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.148817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.148895] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.148979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.149089] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.149719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.149893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.150083] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.150165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.150221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.150358] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.150435] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.150519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.150763] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.150837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.150897] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.151053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.151182] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.151273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.151334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.151468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.151542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.151620] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.151699] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.152898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.153070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.153502] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.153601] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.153837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.154600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.154765] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.154794] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.155745] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.155913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.156209] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.156209] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.156330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.156359] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.156598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.156651] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.442442] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.442843] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.442928] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.443272] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.443441] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.443633] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3 not found, creating... [ 940.444110] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.444353] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.444531] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.444793] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.445069] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.445692] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.445882] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.446389] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.446668] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.446815] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.446965] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3 is going to be created. [ 940.470073] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.470307] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.470432] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.470738] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.470977] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.471220] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.654078] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12061c22-6f53-4a32-9e09-aacd3a271bb1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.656787] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.656787] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.656787] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.656787] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.656787] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.656787] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.656787] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.656787] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.656787] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.656787] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.656787] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 is going to be deleted. [ 940.659673] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.661248] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.661248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.661248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.661248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.661464] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.661464] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.661604] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.661604] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.664139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.664139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.664139] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac4b252c-75eb-46d7-adb1-3c832626f301 is going to be updated. [ 940.664139] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.665336] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6: rpc.has_security_group_logging(os_id): False [ 940.690015] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.690233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.690343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.690894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.691888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.692782] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.692950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.693041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.693416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.693926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.694283] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.694376] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.694414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.694569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.694650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.694851] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.694950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.695027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.695193] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.695271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.695358] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 940.707537] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.707697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.707744] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.707974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.708142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.721100] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac4b252c-75eb-46d7-adb1-3c832626f301 in Status: IN_PROGRESS for 2s [ 940.721874] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.722025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.722088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.722307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.722401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.722500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.789467] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.789566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.789733] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.789853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.790017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.826591] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 941.017026] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 941.017340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.162933] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12061c22-6f53-4a32-9e09-aacd3a271bb1: rpc.has_security_group_logging(os_id): False [ 941.167936] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac4b252c-75eb-46d7-adb1-3c832626f301: rpc.has_security_group_logging(os_id): False [ 941.169888] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.189162] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.189462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.189462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.189541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.189625] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.189884] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.189980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.190063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.190785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.190785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.190785] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 is going to be created. [ 941.193635] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.193635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.193635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.193862] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.194111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.194573] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.194737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.194897] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.195127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.195271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.195403] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac4b252c-75eb-46d7-adb1-3c832626f301 is going to be updated. [ 941.217551] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/12061c22-6f53-4a32-9e09-aacd3a271bb1], does not exist path=[/infra/domains/default/groups/12061c22-6f53-4a32-9e09-aacd3a271bb1]."\n}' [ 941.217766] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/12061c22-6f53-4a32-9e09-aacd3a271bb1 [ 941.217879] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 941.254564] env[65359]: INFO networking_nsxv3.common.synchronization [req-46033f61-443c-4626-a427-564c14b59f8c req-cd6d7724-51c4-49ac-8a3e-34ce3515dabf service nova] Enqueued Resource ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d with Priority: HIGHEST for action security_group_rules [ 941.254746] env[65359]: INFO networking_nsxv3.common.synchronization [req-46033f61-443c-4626-a427-564c14b59f8c req-cd6d7724-51c4-49ac-8a3e-34ce3515dabf service nova] Enqueued Resource ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d with Priority: HIGHEST for action security_group_members [ 941.254870] env[65359]: INFO networking_nsxv3.common.synchronization [req-46033f61-443c-4626-a427-564c14b59f8c req-cd6d7724-51c4-49ac-8a3e-34ce3515dabf service nova] Enqueued Resource ID: e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3 with Priority: HIGHEST for action port [ 941.256267] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d with Priority: HIGHEST for action security_group_rules [ 941.256419] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d with Priority: HIGHEST for action security_group_members [ 941.256524] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3 with Priority: HIGHEST for action port [ 941.256866] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a269c68-1fd7-4085-a1d3-54f407762a6d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.257107] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.257168] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.257431] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.257463] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a269c68-1fd7-4085-a1d3-54f407762a6d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.263670] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a269c68-1fd7-4085-a1d3-54f407762a6d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.263890] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.263966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.264221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.264386] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.264490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.264554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.264721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.264805] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.264904] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a269c68-1fd7-4085-a1d3-54f407762a6d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.265896] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.267595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.267595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.267595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.267595] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.270540] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.270672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.270733] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.270905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.271801] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.272079] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.272181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.272275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.272397] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.272473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.273094] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.273094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.273619] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.273807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.274714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.274714] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12061c22-6f53-4a32-9e09-aacd3a271bb1 is going to be created. [ 941.277074] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.277191] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.278842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.279109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.279464] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.296361] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac4b252c-75eb-46d7-adb1-3c832626f301 in Status: IN_PROGRESS for 2s [ 941.301176] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/12061c22-6f53-4a32-9e09-aacd3a271bb1], does not exist path=[/infra/domains/default/groups/12061c22-6f53-4a32-9e09-aacd3a271bb1]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/12061c22-6f53-4a32-9e09-aacd3a271bb1 [ 941.301450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12061c22-6f53-4a32-9e09-aacd3a271bb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.302025] env[65359]: Traceback (most recent call last): [ 941.302025] env[65359]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 941.302025] env[65359]: return func(*args, **kwargs) [ 941.302025] env[65359]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 941.302025] env[65359]: res.raise_for_status() [ 941.302025] env[65359]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 941.302025] env[65359]: raise HTTPError(http_error_msg, response=self) [ 941.302025] env[65359]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/12061c22-6f53-4a32-9e09-aacd3a271bb1 [ 941.302025] env[65359]: During handling of the above exception, another exception occurred: [ 941.302025] env[65359]: Traceback (most recent call last): [ 941.302025] env[65359]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 941.302025] env[65359]: listener.cb(fileno) [ 941.302025] env[65359]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 941.302025] env[65359]: result = function(*args, **kwargs) [ 941.302025] env[65359]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 941.302025] env[65359]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 941.302025] env[65359]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 941.302025] env[65359]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 941.302025] env[65359]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 941.302025] env[65359]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 941.302025] env[65359]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 941.302025] env[65359]: res.raise_for_status() [ 941.302025] env[65359]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 941.302025] env[65359]: raise HTTPError(http_error_msg, response=self) [ 941.302025] env[65359]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/12061c22-6f53-4a32-9e09-aacd3a271bb1 [ 941.302025] env[65359]: Removing descriptor: 67 [ 941.512237] env[65359]: INFO networking_nsxv3.common.synchronization [req-b353cd1d-efa9-4b33-aa01-97af5a1f1327 req-5c1c71cc-5a9b-49d9-ad53-5b87e7ecdd1e tempest-AttachVolumeShelveTestJSON-543762586 tempest-AttachVolumeShelveTestJSON-543762586-project-member] Enqueued Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_members [ 941.512812] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 with Priority: HIGHEST for action security_group_members [ 941.513212] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.513325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.513393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.513947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.513947] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.513947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.513947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.514142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.514142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.514230] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f94b344-4b21-4fd0-9c3a-2488e3e7e504',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.673024] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.673024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.673200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.674039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.674039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.674039] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 941.707994] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.708190] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.708190] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.708369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.708508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.725100] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 941.766824] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a269c68-1fd7-4085-a1d3-54f407762a6d taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.766824] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.769139] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a269c68-1fd7-4085-a1d3-54f407762a6d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.781704] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3 with status ACTIVE [ 941.785038] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.785038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.785038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.785038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.785038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.785038] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.785038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.785038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.785038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.785038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.785038] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.785038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.785038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.785038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.785038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.785038] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3 is going to be updated. [ 941.862182] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.862425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.862580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.862801] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.862929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.863101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2c6ec05-4b98-44b3-9a24-9e48bd0e12a3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.017552] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.017842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.017918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.018598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.060671] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.061111] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.061277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.061343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.061591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.061707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.061809] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 is going to be updated. [ 942.102694] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.102694] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.102694] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.103193] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.103796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.122032] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 in Status: IN_PROGRESS for 2s [ 942.269337] env[65359]: INFO networking_nsxv3.common.synchronization [req-c8966161-0b4a-4dc2-a037-80d494968d76 req-e7fbe9a3-11e1-49cd-b756-7bfbec08b62e tempest-ImagesOneServerNegativeTestJSON-1491004073 tempest-ImagesOneServerNegativeTestJSON-1491004073-project-member] Enqueued Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 942.271559] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 942.272126] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a269c68-1fd7-4085-a1d3-54f407762a6d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.273637] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.275635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.275635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.275635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.275635] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.277419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.277419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.277419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.277419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.277419] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.734158] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac4b252c-75eb-46d7-adb1-3c832626f301 in Status: SUCCESS [ 942.735877] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac4b252c-75eb-46d7-adb1-3c832626f301 deletion is rescheduled due to dependency. [ 942.736257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.780622] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.780834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.780914] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.781470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.781470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.781470] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d is going to be created. [ 942.782945] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.783123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.783256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.783503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.823729] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.824420] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.824420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.824420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.824607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.824607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.824664] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 is going to be updated. [ 942.841015] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.841162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.841244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.841474] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.841630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.857456] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d in Status: UNINITIALIZED for 2s [ 942.858400] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 942.858672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.859358] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.859622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.859751] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.876667] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.876667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.876845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.877233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.877411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.889519] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: IN_PROGRESS for 2s [ 943.320886] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac4b252c-75eb-46d7-adb1-3c832626f301 in Status: SUCCESS [ 943.320886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.333694] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.334099] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-196" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.334346] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-196" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.334647] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-196" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.334989] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.335290] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.335429] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.335776] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.335941] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.336178] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.336333] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.336464] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.336575] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.336700] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.336805] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.336975] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.359253] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.359565] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 943.359779] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.360011] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-196" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.360394] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-25b2a0c5-2dc7-4c52-a772-c8882b788f21 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.360595] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-25b2a0c5-2dc7-4c52-a772-c8882b788f21" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.360733] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-25b2a0c5-2dc7-4c52-a772-c8882b788f21" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.361128] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-25b2a0c5-2dc7-4c52-a772-c8882b788f21" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.361345] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25b2a0c5-2dc7-4c52-a772-c8882b788f21',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.363347] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.363498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.734159] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 943.734459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.734707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.735028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.735288] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.735460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.735555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.735768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.735878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.735996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.736410] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.865364] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.865572] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.865696] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.866021] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.866187] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.866401] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 25b2a0c5-2dc7-4c52-a772-c8882b788f21 not found, creating... [ 943.866640] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.866837] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.866966] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.867223] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.867364] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.867692] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.867848] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.867968] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.868224] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.868359] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.868506] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 25b2a0c5-2dc7-4c52-a772-c8882b788f21 is going to be created. [ 943.897690] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.897962] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.898179] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.898512] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.898968] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.898968] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-25b2a0c5-2dc7-4c52-a772-c8882b788f21" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.132551] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 in Status: SUCCESS [ 944.132851] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f94b344-4b21-4fd0-9c3a-2488e3e7e504 deletion is rescheduled due to dependency. [ 944.132995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f94b344-4b21-4fd0-9c3a-2488e3e7e504" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.238873] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.239120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.239227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.239485] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.239720] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.239854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.239942] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.240164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.240255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.240358] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.240512] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.240608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.240688] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.240877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.241042] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.241152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.241227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.241367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.241476] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.241515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.241625] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.628672] env[65359]: INFO networking_nsxv3.common.synchronization [req-c8966161-0b4a-4dc2-a037-80d494968d76 req-2c107378-b993-4c0d-a018-45583940894b service nova] Enqueued Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_rules [ 944.628672] env[65359]: INFO networking_nsxv3.common.synchronization [req-c8966161-0b4a-4dc2-a037-80d494968d76 req-2c107378-b993-4c0d-a018-45583940894b service nova] Enqueued Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 944.628996] env[65359]: INFO networking_nsxv3.common.synchronization [req-c8966161-0b4a-4dc2-a037-80d494968d76 req-2c107378-b993-4c0d-a018-45583940894b service nova] Enqueued Resource ID: 25b2a0c5-2dc7-4c52-a772-c8882b788f21 with Priority: HIGHEST for action port [ 944.630014] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_rules [ 944.630315] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 944.630626] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25b2a0c5-2dc7-4c52-a772-c8882b788f21 with Priority: HIGHEST for action port [ 944.631387] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.631387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.631387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.631643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.631643] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.632883] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.632883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.633057] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-25b2a0c5-2dc7-4c52-a772-c8882b788f21 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.633190] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25b2a0c5-2dc7-4c52-a772-c8882b788f21" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.633284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25b2a0c5-2dc7-4c52-a772-c8882b788f21" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.633426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25b2a0c5-2dc7-4c52-a772-c8882b788f21" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.633505] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25b2a0c5-2dc7-4c52-a772-c8882b788f21',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.744415] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6: rpc.has_security_group_logging(os_id): False [ 944.762823] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.763088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.763230] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.763543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.789371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.789371] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.789371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.789371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.789769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.789769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.789769] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.789917] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.789960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.790125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.790194] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.790385] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.790477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.790544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.790692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.790932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.791111] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 944.856796] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.856979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.857034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.857243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.857390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.867899] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d in Status: SUCCESS [ 944.868195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.868410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.868678] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.868922] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.869116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.869416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.869623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.869704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.869804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.869898] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a269c68-1fd7-4085-a1d3-54f407762a6d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.874610] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 944.898663] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: SUCCESS [ 944.898882] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 deletion is rescheduled due to dependency. [ 944.899074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.899376] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.899602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.899896] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.900027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.900110] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.900307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.900393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.900488] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.135465] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.135713] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.135905] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25b2a0c5-2dc7-4c52-a772-c8882b788f21 with status ACTIVE [ 945.136169] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.136315] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.136426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.137509] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.137700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.137852] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.137955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.138167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.138731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.138731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.138731] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.138731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.138731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.138731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.139155] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.139155] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25b2a0c5-2dc7-4c52-a772-c8882b788f21 is going to be updated. [ 945.166192] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.166192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.166457] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.166835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.166835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.167009] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25b2a0c5-2dc7-4c52-a772-c8882b788f21" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.372597] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a269c68-1fd7-4085-a1d3-54f407762a6d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.402812] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.785892] env[65359]: INFO networking_nsxv3.common.synchronization [req-09fac11d-93f2-4fbe-abf4-0eef3b4488cf req-16d86c41-7282-43e6-9d03-e750a5f4b38c tempest-AttachVolumeTestJSON-1956829346 tempest-AttachVolumeTestJSON-1956829346-project-member] Enqueued Resource ID: 52365fff-e017-4d11-ba53-f5893d863536 with Priority: HIGHEST for action security_group_members [ 945.786578] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52365fff-e017-4d11-ba53-f5893d863536 with Priority: HIGHEST for action security_group_members [ 945.786897] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-52365fff-e017-4d11-ba53-f5893d863536 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.787662] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.787782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.788027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.788396] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.788396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.788547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.788645] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.788736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.789080] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52365fff-e017-4d11-ba53-f5893d863536',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.875698] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a269c68-1fd7-4085-a1d3-54f407762a6d: rpc.has_security_group_logging(os_id): False [ 945.897352] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.897482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.898228] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.898228] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.898228] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.898228] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.898422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.898422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.898530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.898635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.898693] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d is going to be created. [ 945.908202] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.968356] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.968356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.968356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.968356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.968356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.979436] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d in Status: IN_PROGRESS for 2s [ 946.102966] env[65359]: INFO networking_nsxv3.common.synchronization [None req-5f3c27b0-43b9-4c19-9cb0-74b915012982 None None] Enqueued Resource ID: a534d7c6-056e-4b3a-8de9-bb54f3b9e7aa with Priority: HIGHEST for action port [ 946.103670] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a534d7c6-056e-4b3a-8de9-bb54f3b9e7aa with Priority: HIGHEST for action port [ 946.104117] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-a534d7c6-056e-4b3a-8de9-bb54f3b9e7aa taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.104262] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a534d7c6-056e-4b3a-8de9-bb54f3b9e7aa" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.104499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a534d7c6-056e-4b3a-8de9-bb54f3b9e7aa" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.105484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a534d7c6-056e-4b3a-8de9-bb54f3b9e7aa" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.105484] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a534d7c6-056e-4b3a-8de9-bb54f3b9e7aa',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.294708] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.294708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.294939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.295616] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.330880] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.332290] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.332290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.332290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.332290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.332290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.332290] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52365fff-e017-4d11-ba53-f5893d863536 is going to be updated. [ 946.367350] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.367526] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.367579] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.367798] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.367963] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.380613] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52365fff-e017-4d11-ba53-f5893d863536 in Status: IN_PROGRESS for 2s [ 946.410922] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.411123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.411194] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.411465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.411513] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.411581] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 is going to be updated. [ 946.419237] env[65359]: INFO networking_nsxv3.common.synchronization [None req-2fdee6bc-1b40-433b-aef8-9d90791b8ac9 None None] Enqueued Resource ID: e581eec6-94e6-4663-af0d-c8e0424a83c9 with Priority: HIGHEST for action port [ 946.420276] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e581eec6-94e6-4663-af0d-c8e0424a83c9 with Priority: HIGHEST for action port [ 946.420384] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-e581eec6-94e6-4663-af0d-c8e0424a83c9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.420503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e581eec6-94e6-4663-af0d-c8e0424a83c9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.420571] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e581eec6-94e6-4663-af0d-c8e0424a83c9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.420872] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e581eec6-94e6-4663-af0d-c8e0424a83c9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.421182] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e581eec6-94e6-4663-af0d-c8e0424a83c9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.455912] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.455912] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.456167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.456287] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.456374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.468161] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: IN_PROGRESS for 2s [ 946.608108] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a534d7c6-056e-4b3a-8de9-bb54f3b9e7aa [ 946.608108] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.608108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.608108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.608268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.608268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.608371] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a534d7c6-056e-4b3a-8de9-bb54f3b9e7aa already deleted. [ 946.608453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a534d7c6-056e-4b3a-8de9-bb54f3b9e7aa" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.728436] env[65359]: INFO networking_nsxv3.common.synchronization [req-f9fd15b8-003a-4d3b-a929-94f534d884c9 req-613c8147-839d-4160-a45d-e4cc3ae4f420 tempest-ServerActionsV293TestJSON-1704396028 tempest-ServerActionsV293TestJSON-1704396028-project-member] Enqueued Resource ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e with Priority: HIGHEST for action security_group_members [ 946.729395] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e with Priority: HIGHEST for action security_group_members [ 946.729731] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.729842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.729921] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.733046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.733046] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.733046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.733046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.733046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.733046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.733046] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c69a6fc7-9355-4fca-ac8f-5d59227f6c2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.892517] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 946.893630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.923381] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e581eec6-94e6-4663-af0d-c8e0424a83c9 [ 946.923666] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.923996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.924240] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.924333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.924429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.924996] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e581eec6-94e6-4663-af0d-c8e0424a83c9 already deleted. [ 946.924996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e581eec6-94e6-4663-af0d-c8e0424a83c9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.234657] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.234882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.235024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.235609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.235609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.235609] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.235792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.235792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.236025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.236025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.236085] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e already deleted. [ 947.236153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.592357] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.592710] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-931" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.592995] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-931" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.593541] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-931" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.596906] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.596906] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.596906] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.596906] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.596906] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.596906] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.596906] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.596906] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.596906] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.596906] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.596906] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.596906] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.625760] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.626587] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 947.626587] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.626587] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-931" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.626587] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-56da9a54-b161-4cc0-897d-f5698dd4616b taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.627077] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-56da9a54-b161-4cc0-897d-f5698dd4616b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.627077] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-56da9a54-b161-4cc0-897d-f5698dd4616b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.627295] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-56da9a54-b161-4cc0-897d-f5698dd4616b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.627398] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56da9a54-b161-4cc0-897d-f5698dd4616b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.994116] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d in Status: SUCCESS [ 947.994463] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.131490] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.131685] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.131685] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.132020] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.132250] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.132386] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 56da9a54-b161-4cc0-897d-f5698dd4616b not found, creating... [ 948.132662] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.132980] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.133190] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.133470] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.133643] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.133960] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.134146] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.134268] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.134542] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.134658] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.134803] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 56da9a54-b161-4cc0-897d-f5698dd4616b is going to be created. [ 948.160534] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.160680] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.160724] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.161054] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.161278] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.161498] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-56da9a54-b161-4cc0-897d-f5698dd4616b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.238329] env[65359]: INFO networking_nsxv3.common.synchronization [req-6147a329-d69c-4d7b-b452-aede414bc8a9 req-d3ea362d-875e-4e16-a900-21d9530a8331 tempest-ServerDiskConfigTestJSON-2085995032 tempest-ServerDiskConfigTestJSON-2085995032-project-member] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 948.238614] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 948.238941] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.240642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.240642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.240642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.240642] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.240642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.240944] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.240944] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.241047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.241100] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.377966] env[65359]: INFO networking_nsxv3.common.synchronization [None req-14e1fac8-6ed9-4de2-8984-8b03e973c213 None None] Enqueued Resource ID: 0af51a21-f35f-4994-a421-f58c6a9e8329 with Priority: HIGHEST for action port [ 948.379031] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af51a21-f35f-4994-a421-f58c6a9e8329 with Priority: HIGHEST for action port [ 948.379813] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-0af51a21-f35f-4994-a421-f58c6a9e8329 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.379813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0af51a21-f35f-4994-a421-f58c6a9e8329" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.379813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0af51a21-f35f-4994-a421-f58c6a9e8329" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.380164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0af51a21-f35f-4994-a421-f58c6a9e8329" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.380164] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0af51a21-f35f-4994-a421-f58c6a9e8329',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.394378] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52365fff-e017-4d11-ba53-f5893d863536 in Status: SUCCESS [ 948.394702] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52365fff-e017-4d11-ba53-f5893d863536 deletion is rescheduled due to dependency. [ 948.394828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52365fff-e017-4d11-ba53-f5893d863536" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.480856] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: SUCCESS [ 948.484131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.484131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.484131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.484131] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.484131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.484131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.484131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.484131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.484131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.484131] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.744650] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.746980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.746980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.746980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.770412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.770412] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.770412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.770412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.770653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.770653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.770653] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be updated. [ 948.786398] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-346 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.786640] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.786771] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.787088] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.787377] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.787589] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.787751] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.789365] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.789365] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.789365] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 948.789365] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.789365] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.789365] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.789365] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 948.789365] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.789365] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.810912] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.811169] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 948.811320] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.811496] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.815792] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-c24633e6-496d-4a3f-9314-1b7e885ee577 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.815792] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-c24633e6-496d-4a3f-9314-1b7e885ee577" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.815792] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-c24633e6-496d-4a3f-9314-1b7e885ee577" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.815792] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-c24633e6-496d-4a3f-9314-1b7e885ee577" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.815792] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c24633e6-496d-4a3f-9314-1b7e885ee577',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.820785] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.821155] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.821155] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.821453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.821518] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.838515] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: IN_PROGRESS for 2s [ 948.884448] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0af51a21-f35f-4994-a421-f58c6a9e8329 [ 948.884837] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.884991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.885094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.885461] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.885591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.885717] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0af51a21-f35f-4994-a421-f58c6a9e8329 already deleted. [ 948.885774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0af51a21-f35f-4994-a421-f58c6a9e8329" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.924432] env[65359]: INFO networking_nsxv3.common.synchronization [req-f9fd15b8-003a-4d3b-a929-94f534d884c9 req-de75c668-2d93-4368-990d-de5198fe5814 service nova] Enqueued Resource ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e with Priority: HIGHEST for action security_group_rules [ 948.924762] env[65359]: INFO networking_nsxv3.common.synchronization [req-f9fd15b8-003a-4d3b-a929-94f534d884c9 req-de75c668-2d93-4368-990d-de5198fe5814 service nova] Enqueued Resource ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e with Priority: HIGHEST for action security_group_members [ 948.924935] env[65359]: INFO networking_nsxv3.common.synchronization [req-f9fd15b8-003a-4d3b-a929-94f534d884c9 req-de75c668-2d93-4368-990d-de5198fe5814 service nova] Enqueued Resource ID: 56da9a54-b161-4cc0-897d-f5698dd4616b with Priority: HIGHEST for action port [ 948.925626] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e with Priority: HIGHEST for action security_group_rules [ 948.925995] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e with Priority: HIGHEST for action security_group_members [ 948.926221] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56da9a54-b161-4cc0-897d-f5698dd4616b with Priority: HIGHEST for action port [ 948.926609] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.926842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.926946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.927267] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.927445] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c69a6fc7-9355-4fca-ac8f-5d59227f6c2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.929203] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.929438] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.929606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.929854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.930108] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.930331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.930440] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.930622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.930712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.930840] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c69a6fc7-9355-4fca-ac8f-5d59227f6c2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.931943] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-56da9a54-b161-4cc0-897d-f5698dd4616b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.932399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56da9a54-b161-4cc0-897d-f5698dd4616b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.932399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56da9a54-b161-4cc0-897d-f5698dd4616b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.932399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56da9a54-b161-4cc0-897d-f5698dd4616b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.932540] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56da9a54-b161-4cc0-897d-f5698dd4616b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.989450] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.989450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.989450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.989450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.989450] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.989450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.989753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.989753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.989753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.989833] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.991932] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.992095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.992159] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.992331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.992484] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.992584] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.992647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.992857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.992954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.993116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.993152] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.318477] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.318477] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.318477] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.318477] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.319127] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.319127] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port c24633e6-496d-4a3f-9314-1b7e885ee577 not found, creating... [ 949.319127] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.319684] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.319861] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.320330] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.320389] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.320722] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.320821] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.320968] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.322149] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.322149] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.322246] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: c24633e6-496d-4a3f-9314-1b7e885ee577 is going to be created. [ 949.348802] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.349069] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.349222] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.349577] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.349836] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.353379] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-c24633e6-496d-4a3f-9314-1b7e885ee577" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.439603] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56da9a54-b161-4cc0-897d-f5698dd4616b with status ACTIVE [ 949.439603] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.439603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.439603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.439603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.439603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.439603] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.439603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.439603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.439603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.439603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.439603] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.439603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.439603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.439603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.439603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.439603] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56da9a54-b161-4cc0-897d-f5698dd4616b is going to be updated. [ 949.440769] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.440901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.442469] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c69a6fc7-9355-4fca-ac8f-5d59227f6c2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.469399] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.469575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.469667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.469853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.469989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.471027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56da9a54-b161-4cc0-897d-f5698dd4616b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.496029] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f713e30a-d102-48fb-9e09-3c3ec7abbc99: rpc.has_security_group_logging(os_id): False [ 949.526013] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.526178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.526253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.526474] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.526715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.526872] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.527024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.527090] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.527241] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.527320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.527642] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.527945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.527945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.528341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.528482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.528841] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.529219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.529378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.529735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.529735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.529869] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 is going to be updated. [ 949.640089] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.640271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.640379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.640721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.640847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.664485] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: IN_PROGRESS for 2s [ 949.788184] env[65359]: INFO networking_nsxv3.common.synchronization [None req-c18154a4-1fab-49b6-b9c1-4ecfca386439 None None] Enqueued Resource ID: f24cca3a-3ff8-4675-b07f-4237dfffd07d with Priority: HIGHEST for action port [ 949.788856] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f24cca3a-3ff8-4675-b07f-4237dfffd07d with Priority: HIGHEST for action port [ 949.790355] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-f24cca3a-3ff8-4675-b07f-4237dfffd07d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.790355] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f24cca3a-3ff8-4675-b07f-4237dfffd07d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.790355] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f24cca3a-3ff8-4675-b07f-4237dfffd07d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.790546] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f24cca3a-3ff8-4675-b07f-4237dfffd07d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.790587] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f24cca3a-3ff8-4675-b07f-4237dfffd07d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.946124] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c69a6fc7-9355-4fca-ac8f-5d59227f6c2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.145191] env[65359]: INFO networking_nsxv3.common.synchronization [req-6147a329-d69c-4d7b-b452-aede414bc8a9 req-9f5a9e39-af85-4b1d-be89-af6292d859a3 service nova] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_rules [ 950.145432] env[65359]: INFO networking_nsxv3.common.synchronization [req-6147a329-d69c-4d7b-b452-aede414bc8a9 req-9f5a9e39-af85-4b1d-be89-af6292d859a3 service nova] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 950.145569] env[65359]: INFO networking_nsxv3.common.synchronization [req-6147a329-d69c-4d7b-b452-aede414bc8a9 req-9f5a9e39-af85-4b1d-be89-af6292d859a3 service nova] Enqueued Resource ID: c24633e6-496d-4a3f-9314-1b7e885ee577 with Priority: HIGHEST for action port [ 950.147898] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_rules [ 950.148138] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 950.148377] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c24633e6-496d-4a3f-9314-1b7e885ee577 with Priority: HIGHEST for action port [ 950.149701] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.149927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.149927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.150587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.150587] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.154465] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.154465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.154465] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-c24633e6-496d-4a3f-9314-1b7e885ee577 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.154465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c24633e6-496d-4a3f-9314-1b7e885ee577" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.154465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c24633e6-496d-4a3f-9314-1b7e885ee577" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.154465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c24633e6-496d-4a3f-9314-1b7e885ee577" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.154465] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c24633e6-496d-4a3f-9314-1b7e885ee577',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.298673] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f24cca3a-3ff8-4675-b07f-4237dfffd07d [ 950.298673] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.298673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.298673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.298673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.298673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.298673] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f24cca3a-3ff8-4675-b07f-4237dfffd07d already deleted. [ 950.298673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f24cca3a-3ff8-4675-b07f-4237dfffd07d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.451603] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.451982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.451982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.452151] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.452732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.452732] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e is going to be created. [ 950.483121] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.483246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.483285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.483707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.483707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.497240] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e in Status: UNINITIALIZED for 2s [ 950.657491] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.657491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.657491] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c24633e6-496d-4a3f-9314-1b7e885ee577 with status ACTIVE [ 950.657822] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.657822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.657822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.658020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.658087] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.658259] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.658417] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.658417] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.658811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.658811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.658811] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.659059] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.659059] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.659136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.659432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.659432] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c24633e6-496d-4a3f-9314-1b7e885ee577 is going to be updated. [ 950.682466] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.682622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.682695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.682956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.683090] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.683330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c24633e6-496d-4a3f-9314-1b7e885ee577" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.817614] env[65359]: INFO networking_nsxv3.common.synchronization [req-3879b2ac-209a-4cb0-8f4d-a31ee1e970f8 req-55e5cd97-6170-44c7-b3ef-5c3b223a49d9 tempest-ServersTestJSON-1929866617 tempest-ServersTestJSON-1929866617-project-member] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 950.819029] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 950.819407] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.819601] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.819690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.820011] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.820217] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.820502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.820502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.820598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.820690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.820814] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.851226] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 950.851902] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b deletion is rescheduled due to dependency. [ 950.851902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.851902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.852296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.853404] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.853404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.853404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.853404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.853404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.853404] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.183486] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.183742] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.183909] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.184238] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.184538] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.184717] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.184866] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.185207] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.185364] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.185583] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.185699] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.185810] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.185919] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.186038] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.186192] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.186298] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.206476] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.206696] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 951.206864] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.207110] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.207511] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-ce165114-79f2-42dd-aaa4-3b3b0949683c taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.207613] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-ce165114-79f2-42dd-aaa4-3b3b0949683c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.207692] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-ce165114-79f2-42dd-aaa4-3b3b0949683c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.208133] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-ce165114-79f2-42dd-aaa4-3b3b0949683c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.208283] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce165114-79f2-42dd-aaa4-3b3b0949683c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.323793] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.356185] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.678582] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: SUCCESS [ 951.678866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.711406] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.711751] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.711751] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.712111] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.712268] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.712441] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port ce165114-79f2-42dd-aaa4-3b3b0949683c not found, creating... [ 951.712714] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.712914] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.713814] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.713814] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.713814] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.713814] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.714055] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.714164] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.714399] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.714603] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.714773] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: ce165114-79f2-42dd-aaa4-3b3b0949683c is going to be created. [ 951.734931] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.735179] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.735304] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.735566] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.735788] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.736023] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-ce165114-79f2-42dd-aaa4-3b3b0949683c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.826391] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.858519] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.329315] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.332112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.332112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.332112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.332112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.332112] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 952.364072] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.364072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.364072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.364072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.364072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.364072] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be updated. [ 952.368197] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.368197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.368197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.368197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.368197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.377631] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 952.400818] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.400818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.400818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.400818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.400818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.412763] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: IN_PROGRESS for 2s [ 952.506920] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e in Status: SUCCESS [ 952.507203] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.507441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.507871] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.508014] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.508216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.508328] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.508568] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.508685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.508815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.508952] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c69a6fc7-9355-4fca-ac8f-5d59227f6c2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.516517] env[65359]: INFO networking_nsxv3.common.synchronization [req-3879b2ac-209a-4cb0-8f4d-a31ee1e970f8 req-95a4b58e-15e2-4de0-91cd-55dc0642ac1e service nova] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_rules [ 952.516659] env[65359]: INFO networking_nsxv3.common.synchronization [req-3879b2ac-209a-4cb0-8f4d-a31ee1e970f8 req-95a4b58e-15e2-4de0-91cd-55dc0642ac1e service nova] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 952.517799] env[65359]: INFO networking_nsxv3.common.synchronization [req-3879b2ac-209a-4cb0-8f4d-a31ee1e970f8 req-95a4b58e-15e2-4de0-91cd-55dc0642ac1e service nova] Enqueued Resource ID: ce165114-79f2-42dd-aaa4-3b3b0949683c with Priority: HIGHEST for action port [ 952.518609] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_rules [ 952.518755] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 952.518852] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce165114-79f2-42dd-aaa4-3b3b0949683c with Priority: HIGHEST for action port [ 952.519879] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.520124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.520124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.520329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.520419] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.521909] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.522040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.522250] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce165114-79f2-42dd-aaa4-3b3b0949683c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.522356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce165114-79f2-42dd-aaa4-3b3b0949683c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.522452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce165114-79f2-42dd-aaa4-3b3b0949683c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.522689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce165114-79f2-42dd-aaa4-3b3b0949683c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.522781] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce165114-79f2-42dd-aaa4-3b3b0949683c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.015472] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c69a6fc7-9355-4fca-ac8f-5d59227f6c2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.022375] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.022503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.025883] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce165114-79f2-42dd-aaa4-3b3b0949683c with status ACTIVE [ 953.026181] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.026326] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.026396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.026607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.026714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.026905] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.027019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.027070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.027237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.027331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.027572] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.027673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.027739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.027875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.027949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.028049] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce165114-79f2-42dd-aaa4-3b3b0949683c is going to be updated. [ 953.056338] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.056497] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.056598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.056816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.057022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.057175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce165114-79f2-42dd-aaa4-3b3b0949683c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.517870] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c69a6fc7-9355-4fca-ac8f-5d59227f6c2e: rpc.has_security_group_logging(os_id): False [ 953.536729] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.536877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.536999] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.537201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.537323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.537610] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.537732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.537775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.538371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.538371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.538371] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e is going to be created. [ 953.614061] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.614285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.614358] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.614582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.614796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.627189] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e in Status: IN_PROGRESS for 2s [ 954.391707] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 954.392106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.392106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.392411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.392595] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.392738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.392794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.393058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.393171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.393997] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.428108] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 954.430032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.430032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.430032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.430032] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.430032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.430032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.430032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.430032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.430032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.430520] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.897494] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.932483] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.932622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.932700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.933034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.933214] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.933331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.933398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.933577] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.933691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.933800] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.933937] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.934189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.934189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.934279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.937043] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.937043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.937043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.937043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.937043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.937043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.937043] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.350670] env[65359]: INFO networking_nsxv3.common.synchronization [req-c15063a0-ccac-4b1f-b816-b9a111e15ee0 req-8f199aab-84c3-4c5e-bf99-11ed561df2b1 tempest-ServersWithSpecificFlavorTestJSON-1171930916 tempest-ServersWithSpecificFlavorTestJSON-1171930916-project-member] Enqueued Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_members [ 955.351614] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGHEST for action security_group_members [ 955.351614] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.351773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.351807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.352201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.352364] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.352481] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.352862] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.352862] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.352862] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.352996] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.400970] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.437211] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4dca704-f8c2-494f-bbf6-802020c49b4b: rpc.has_security_group_logging(os_id): False [ 955.456829] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.457079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.457485] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.457485] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.457612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.458200] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.458200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.458200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.458200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.460380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.460380] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.460380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.460380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.460380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.460380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.460380] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.460380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.460380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.460927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.460927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.460927] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be updated. [ 955.544786] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.545316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.545316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.545478] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.545927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.565731] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: IN_PROGRESS for 2s [ 955.656036] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e in Status: SUCCESS [ 955.656036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.854771] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.855512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.855648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.855940] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.883239] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.883560] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.883680] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.883751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.884633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.884633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.884633] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 is going to be updated. [ 955.903398] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.903595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.903667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.904038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.904148] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.904269] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 955.918462] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.918789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.918789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.919258] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.919434] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.929771] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 in Status: IN_PROGRESS for 2s [ 955.940650] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.940894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.941017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.941491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.941491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.958317] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 956.964140] env[65359]: INFO networking_nsxv3.common.synchronization [req-a20612e2-799c-415e-8e2a-c8f090278167 req-2c570019-6d5c-4bc9-b8a0-4fe016194d9f tempest-ImagesOneServerNegativeTestJSON-1491004073 tempest-ImagesOneServerNegativeTestJSON-1491004073-project-member] Enqueued Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 956.964856] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 with Priority: HIGHEST for action security_group_members [ 956.964856] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-f713e30a-d102-48fb-9e09-3c3ec7abbc99 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.964856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.964856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.966189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.966189] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.966189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.966189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.966189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.966189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.966189] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f713e30a-d102-48fb-9e09-3c3ec7abbc99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.470025] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.470271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.473236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.474028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.474028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.474281] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.474281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.474281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.474488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.474774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.474774] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 is going to be updated. [ 957.514635] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.514836] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.514882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.515115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.518309] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.530338] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: IN_PROGRESS for 2s [ 957.582959] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 957.584260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.942687] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 in Status: SUCCESS [ 957.942945] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 deletion is rescheduled due to dependency. [ 957.943094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.970422] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 957.970767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.970831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.971069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.971271] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.971392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.971458] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.971612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.971694] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.971779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.971874] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.475403] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.475403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.475403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.475403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.475662] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.475662] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.475816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.475902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.476094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.476146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.476309] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.477319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.477319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.477319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.477319] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.477319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.477319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.477319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.477319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.477319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.477319] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.983968] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5: rpc.has_security_group_logging(os_id): False [ 959.008648] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.008848] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.008992] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.009392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.032964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.033331] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.033426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.033499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.033700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.033785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.033982] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.034098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.034162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.034317] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.034390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.034565] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.034673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.034746] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.036061] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.036452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.036532] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 959.101014] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.101014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.101014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.101220] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.101373] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.119932] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 959.212768] env[65359]: INFO networking_nsxv3.common.synchronization [None req-9dcc8dc8-4161-40fd-bf22-9bf399c90edd None None] Enqueued Resource ID: 9b7c602d-54ff-43f1-a99d-09c6e47ef77b with Priority: HIGHEST for action port [ 959.213489] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7c602d-54ff-43f1-a99d-09c6e47ef77b with Priority: HIGHEST for action port [ 959.213856] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b7c602d-54ff-43f1-a99d-09c6e47ef77b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.214090] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b7c602d-54ff-43f1-a99d-09c6e47ef77b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.214215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b7c602d-54ff-43f1-a99d-09c6e47ef77b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.214627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b7c602d-54ff-43f1-a99d-09c6e47ef77b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.214761] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b7c602d-54ff-43f1-a99d-09c6e47ef77b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.542420] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 in Status: SUCCESS [ 959.542420] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f713e30a-d102-48fb-9e09-3c3ec7abbc99 deletion is rescheduled due to dependency. [ 959.542420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f713e30a-d102-48fb-9e09-3c3ec7abbc99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.717032] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b7c602d-54ff-43f1-a99d-09c6e47ef77b [ 959.717437] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.717798] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.717798] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.718089] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.719031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.719031] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b7c602d-54ff-43f1-a99d-09c6e47ef77b already deleted. [ 959.719031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b7c602d-54ff-43f1-a99d-09c6e47ef77b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.059980] env[65359]: INFO networking_nsxv3.common.synchronization [req-157f4d5c-aafa-4ba0-98b0-5f74cbe617b4 req-8b232780-a406-4763-88a8-7f00cf419400 tempest-ImagesTestJSON-1497561183 tempest-ImagesTestJSON-1497561183-project-member] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 960.063099] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 960.063976] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.066111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.066111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.066111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.066111] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.066111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.066111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.066111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.066111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.066111] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.460425] env[65359]: INFO networking_nsxv3.common.synchronization [None req-2a80b90c-7d00-4de8-b72d-137210b8a01d tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGHEST for action security_group_rules [ 960.461228] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGHEST for action security_group_rules [ 960.461739] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0a461a8-ce41-468d-b9bb-19fef2690b98 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.462468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.462468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.462468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.462620] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0a461a8-ce41-468d-b9bb-19fef2690b98',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.554377] env[65359]: INFO networking_nsxv3.common.synchronization [None req-816fd4c7-1f89-435b-a26f-3df34ef6dd48 tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGHEST for action security_group_rules [ 960.554968] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGHEST for action security_group_rules [ 960.555402] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0a461a8-ce41-468d-b9bb-19fef2690b98 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.555529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.569077] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.569298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.569394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.569632] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.590771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.591096] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.591232] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.592320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.592320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.592320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.592320] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 960.622340] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.622518] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.622585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.622765] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.622937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.633176] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 960.985102] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.985292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.985367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.985577] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.985791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.985791] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 already deleted. [ 960.985894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.985975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.986145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.986228] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0a461a8-ce41-468d-b9bb-19fef2690b98',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.143370] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 961.143704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.509478] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.509726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.509807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.510089] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.510229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.510354] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 already deleted. [ 961.510449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.714679] env[65359]: INFO networking_nsxv3.common.synchronization [None req-d2966568-10cc-400a-af0a-9f8a937d9bea None None] Enqueued Resource ID: 0dd908f1-4e45-4e5e-9494-3b818c6bc801 with Priority: HIGHEST for action port [ 961.715406] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd908f1-4e45-4e5e-9494-3b818c6bc801 with Priority: HIGHEST for action port [ 961.715792] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-0dd908f1-4e45-4e5e-9494-3b818c6bc801 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.715990] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0dd908f1-4e45-4e5e-9494-3b818c6bc801" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.716083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0dd908f1-4e45-4e5e-9494-3b818c6bc801" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.716445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0dd908f1-4e45-4e5e-9494-3b818c6bc801" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.716555] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0dd908f1-4e45-4e5e-9494-3b818c6bc801',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.219038] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0dd908f1-4e45-4e5e-9494-3b818c6bc801 [ 962.219573] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.219573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.219573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.220531] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.220531] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.220531] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0dd908f1-4e45-4e5e-9494-3b818c6bc801 already deleted. [ 962.220531] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0dd908f1-4e45-4e5e-9494-3b818c6bc801" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.365536] env[65359]: INFO networking_nsxv3.common.synchronization [req-762fe053-70ce-4367-9e53-b01695c07bcc req-0424f6be-1889-4c8a-b162-a9af5ba660e6 tempest-DeleteServersTestJSON-2065668722 tempest-DeleteServersTestJSON-2065668722-project-member] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 962.367019] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 962.367528] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.367889] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.368070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.368427] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.372114] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.372541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.372541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.372541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.372692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.372728] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.644825] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 962.645031] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 deletion is rescheduled due to dependency. [ 962.645158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.876290] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.876498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.876498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.876706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.897573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.897708] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.897898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.897995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.898217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.898346] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.898460] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 962.927522] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.927775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.927957] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.928120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.928279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.939637] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 964.003459] env[65359]: INFO networking_nsxv3.common.synchronization [req-96a7b49c-4f02-4dad-888e-d5686ebe4cf0 req-ed8445f1-b2a4-401c-b864-951f63ef93c1 tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 964.004413] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 964.004413] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.004624] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.004624] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.004981] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.004981] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.004981] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.004981] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.006250] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.006250] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.006250] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.433084] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.433293] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.433418] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.433708] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.434018] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.434374] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.434504] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.434759] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.434930] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.435160] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.435274] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.435383] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.435489] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.435596] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.435699] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.435835] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.460888] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.461074] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 964.461688] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.461688] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.461688] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-eb80511c-b767-4fd0-a824-ad5588a726a2 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.461911] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-eb80511c-b767-4fd0-a824-ad5588a726a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.462060] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-eb80511c-b767-4fd0-a824-ad5588a726a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.462374] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-eb80511c-b767-4fd0-a824-ad5588a726a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.462524] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb80511c-b767-4fd0-a824-ad5588a726a2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.509350] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.509505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.509583] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.510865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.532429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.532809] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.533051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.533051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.533262] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.533347] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.533447] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be updated. [ 964.560595] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.560916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.560916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.561175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.561361] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.575630] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 2s [ 964.949391] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 964.949591] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb deletion is rescheduled due to dependency. [ 964.949709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.965090] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.965397] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.965533] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.966183] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.966183] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.966183] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port eb80511c-b767-4fd0-a824-ad5588a726a2 not found, creating... [ 964.966356] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.966515] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.966631] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.966852] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.966988] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.967287] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.967441] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.967555] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.967754] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.967881] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.968028] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: eb80511c-b767-4fd0-a824-ad5588a726a2 is going to be created. [ 964.990094] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.990094] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.990094] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.990094] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.990428] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.990559] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-eb80511c-b767-4fd0-a824-ad5588a726a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.478040] env[65359]: INFO networking_nsxv3.common.synchronization [None req-0f61c5f4-c180-4947-a083-81f385c4fc78 tempest-AttachVolumeShelveTestJSON-543762586 tempest-AttachVolumeShelveTestJSON-543762586-project-member] Enqueued Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_rules [ 965.478841] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_rules [ 965.481015] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db3579e6-ea77-4102-ba19-0829034e0bac taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.482428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.482428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.482428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.482428] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.639603] env[65359]: INFO networking_nsxv3.common.synchronization [None req-4441eb76-2714-4755-8498-0cddf83084a4 tempest-AttachVolumeShelveTestJSON-543762586 tempest-AttachVolumeShelveTestJSON-543762586-project-member] Enqueued Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_rules [ 965.640369] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_rules [ 965.640711] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db3579e6-ea77-4102-ba19-0829034e0bac taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.640818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.730839] env[65359]: INFO networking_nsxv3.common.synchronization [req-96a7b49c-4f02-4dad-888e-d5686ebe4cf0 req-65c3c5c0-3885-4992-b649-d1e8ab1f0985 service nova] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_rules [ 965.731031] env[65359]: INFO networking_nsxv3.common.synchronization [req-96a7b49c-4f02-4dad-888e-d5686ebe4cf0 req-65c3c5c0-3885-4992-b649-d1e8ab1f0985 service nova] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 965.731173] env[65359]: INFO networking_nsxv3.common.synchronization [req-96a7b49c-4f02-4dad-888e-d5686ebe4cf0 req-65c3c5c0-3885-4992-b649-d1e8ab1f0985 service nova] Enqueued Resource ID: eb80511c-b767-4fd0-a824-ad5588a726a2 with Priority: HIGHEST for action port [ 965.731673] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_rules [ 965.731808] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 965.731904] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb80511c-b767-4fd0-a824-ad5588a726a2 with Priority: HIGHEST for action port [ 965.732341] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.732455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.732493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.732690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.732761] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.734229] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.734289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.734511] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb80511c-b767-4fd0-a824-ad5588a726a2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.734622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb80511c-b767-4fd0-a824-ad5588a726a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.734687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb80511c-b767-4fd0-a824-ad5588a726a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.734877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb80511c-b767-4fd0-a824-ad5588a726a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.734954] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb80511c-b767-4fd0-a824-ad5588a726a2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.160267] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.160446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.160554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.160818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.161088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.161279] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db3579e6-ea77-4102-ba19-0829034e0bac already deleted. [ 966.161341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.161484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.161670] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.161789] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.237157] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.237157] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.237325] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb80511c-b767-4fd0-a824-ad5588a726a2 with status ACTIVE [ 966.237545] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.237664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.237728] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.237947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.238066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.238351] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.238437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.238437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.238595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.238677] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.241059] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.241256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.241373] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.241626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.241750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.241886] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb80511c-b767-4fd0-a824-ad5588a726a2 is going to be updated. [ 966.265608] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.265806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.265872] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.266205] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.266392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.266632] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb80511c-b767-4fd0-a824-ad5588a726a2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.585963] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 966.586412] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 deletion is rescheduled due to dependency. [ 966.586412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.586585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.586976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.587333] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.587553] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.587656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.587855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.587955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.588489] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.606428] env[65359]: INFO networking_nsxv3.common.synchronization [req-94be41b2-4cf5-41c8-beac-083fc44665ec req-f3cea920-087d-4711-a32b-2c60e6fd1ce2 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: daa8b334-470d-4702-9560-94a964a51d78 with Priority: HIGHEST for action security_group_members [ 966.606689] env[65359]: INFO networking_nsxv3.common.synchronization [req-94be41b2-4cf5-41c8-beac-083fc44665ec req-f3cea920-087d-4711-a32b-2c60e6fd1ce2 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 966.606746] env[65359]: INFO networking_nsxv3.common.synchronization [req-94be41b2-4cf5-41c8-beac-083fc44665ec req-f3cea920-087d-4711-a32b-2c60e6fd1ce2 tempest-SecurityGroupsTestJSON-871079694 tempest-SecurityGroupsTestJSON-871079694-project-member] Enqueued Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGHEST for action security_group_members [ 966.607857] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daa8b334-470d-4702-9560-94a964a51d78 with Priority: HIGHEST for action security_group_members [ 966.608016] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGHEST for action security_group_members [ 966.608879] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGHEST for action security_group_members [ 966.608879] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-daa8b334-470d-4702-9560-94a964a51d78 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.609084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.609084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.609194] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.609408] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.609515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.609581] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.609837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.609929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.610078] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daa8b334-470d-4702-9560-94a964a51d78',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.611549] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.611993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.612080] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.612454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.612600] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.612698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.612760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.612965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.613154] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.613272] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.614513] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-99327ed1-6c09-451a-b316-eb0268988db2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.614624] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.614668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.614860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.615194] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.615389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.615389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.615537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.615749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.615862] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.686778] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.686920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.686961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.687195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.687301] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.687403] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db3579e6-ea77-4102-ba19-0829034e0bac already deleted. [ 966.687502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.720701] env[65359]: INFO networking_nsxv3.common.synchronization [req-d9ca721e-7450-4593-938c-e4ceec583eff req-5110dbe1-da48-436f-b833-cf0f44d81191 tempest-ServerDiagnosticsNegativeTest-432914707 tempest-ServerDiagnosticsNegativeTest-432914707-project-member] Enqueued Resource ID: 721fd3df-fecb-47e7-86f0-25de8502794c with Priority: HIGHEST for action security_group_members [ 966.721590] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 721fd3df-fecb-47e7-86f0-25de8502794c with Priority: HIGHEST for action security_group_members [ 966.722332] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-721fd3df-fecb-47e7-86f0-25de8502794c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.722332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.722332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.722526] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.722637] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.722847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.722847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.723042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.723152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.723255] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('721fd3df-fecb-47e7-86f0-25de8502794c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.089398] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.089650] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.089844] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.090148] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.090445] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.090630] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.090771] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.091038] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.091177] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.091384] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.091496] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.091602] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.091711] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.091819] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.091923] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.092099] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.093509] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.117538] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.117688] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.117758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.117977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.118084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.118289] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.118390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.118451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.118598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.118668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.119106] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be updated. [ 967.120223] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.120223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.120223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.120415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.121570] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.121658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.141293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.141576] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.141702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.141771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.141971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.142068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.142159] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daa8b334-470d-4702-9560-94a964a51d78 is going to be updated. [ 967.144068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.144390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.153621] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.153806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.153806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.154094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.154260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.161965] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: IN_PROGRESS for 2s [ 967.170684] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.170953] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.171076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.171147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.171354] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.171435] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.171530] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99327ed1-6c09-451a-b316-eb0268988db2 is going to be updated. [ 967.175399] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.175556] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.083 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 967.175697] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.175864] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-381" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.176193] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-b47ce784-660a-4588-84d5-5425032cdf2e taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.176360] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-b47ce784-660a-4588-84d5-5425032cdf2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.176473] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-b47ce784-660a-4588-84d5-5425032cdf2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.176797] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-b47ce784-660a-4588-84d5-5425032cdf2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.176934] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b47ce784-660a-4588-84d5-5425032cdf2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.181887] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.182036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.182109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.182300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.182449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.193280] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daa8b334-470d-4702-9560-94a964a51d78 in Status: IN_PROGRESS for 2s [ 967.200746] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.200893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.200962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.201311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.201400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.216389] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99327ed1-6c09-451a-b316-eb0268988db2 in Status: IN_PROGRESS for 2s [ 967.227886] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.228118] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.228118] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.228926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.229513] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.230019] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.230019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.230019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.230200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.230200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.230300] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 721fd3df-fecb-47e7-86f0-25de8502794c already deleted. [ 967.230451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.596084] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.679320] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.679570] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.679731] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.679985] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.680152] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.680307] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port b47ce784-660a-4588-84d5-5425032cdf2e not found, creating... [ 967.680572] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.680734] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.680985] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.681403] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.681403] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.681600] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.681769] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.682148] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.682148] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.682245] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.682377] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: b47ce784-660a-4588-84d5-5425032cdf2e is going to be created. [ 967.704191] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.704191] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.704191] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.704439] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.704686] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.704913] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-b47ce784-660a-4588-84d5-5425032cdf2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.099456] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.099667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.099742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.099965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.100073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.100174] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be updated. [ 968.138192] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.138349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.138468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.138716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.139100] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.150029] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 2s [ 968.373825] env[65359]: INFO networking_nsxv3.common.synchronization [req-d9ca721e-7450-4593-938c-e4ceec583eff req-ce4199c7-d742-4292-a7a9-9390cb565061 service nova] Enqueued Resource ID: 721fd3df-fecb-47e7-86f0-25de8502794c with Priority: HIGHEST for action security_group_rules [ 968.374052] env[65359]: INFO networking_nsxv3.common.synchronization [req-d9ca721e-7450-4593-938c-e4ceec583eff req-ce4199c7-d742-4292-a7a9-9390cb565061 service nova] Enqueued Resource ID: 721fd3df-fecb-47e7-86f0-25de8502794c with Priority: HIGHEST for action security_group_members [ 968.374184] env[65359]: INFO networking_nsxv3.common.synchronization [req-d9ca721e-7450-4593-938c-e4ceec583eff req-ce4199c7-d742-4292-a7a9-9390cb565061 service nova] Enqueued Resource ID: b47ce784-660a-4588-84d5-5425032cdf2e with Priority: HIGHEST for action port [ 968.374767] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 721fd3df-fecb-47e7-86f0-25de8502794c with Priority: HIGHEST for action security_group_rules [ 968.374910] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 721fd3df-fecb-47e7-86f0-25de8502794c with Priority: HIGHEST for action security_group_members [ 968.375013] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47ce784-660a-4588-84d5-5425032cdf2e with Priority: HIGHEST for action port [ 968.375350] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-721fd3df-fecb-47e7-86f0-25de8502794c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.375465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.375528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.375783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.376077] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('721fd3df-fecb-47e7-86f0-25de8502794c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.376756] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-721fd3df-fecb-47e7-86f0-25de8502794c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.377600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.377600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.377600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.377600] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.377600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.377600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.377600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.377600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.377943] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('721fd3df-fecb-47e7-86f0-25de8502794c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.378422] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-b47ce784-660a-4588-84d5-5425032cdf2e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.378823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b47ce784-660a-4588-84d5-5425032cdf2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.378823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b47ce784-660a-4588-84d5-5425032cdf2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.378823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b47ce784-660a-4588-84d5-5425032cdf2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.378823] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b47ce784-660a-4588-84d5-5425032cdf2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.881484] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('721fd3df-fecb-47e7-86f0-25de8502794c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.881484] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-721fd3df-fecb-47e7-86f0-25de8502794c taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.881968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.881968] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b47ce784-660a-4588-84d5-5425032cdf2e with status ACTIVE [ 968.882072] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.882155] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.882314] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.882794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.882794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.882794] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.882899] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.883417] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.883470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.883599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.884078] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.884078] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.884276] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.884351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.884473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.884573] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b47ce784-660a-4588-84d5-5425032cdf2e is going to be updated. [ 968.923321] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.923550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.923550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.924117] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.924117] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.924332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b47ce784-660a-4588-84d5-5425032cdf2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.174195] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 in Status: SUCCESS [ 969.174274] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 deletion is rescheduled due to dependency. [ 969.174348] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.203684] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daa8b334-470d-4702-9560-94a964a51d78 in Status: SUCCESS [ 969.203976] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daa8b334-470d-4702-9560-94a964a51d78 deletion is rescheduled due to dependency. [ 969.204154] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.227196] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99327ed1-6c09-451a-b316-eb0268988db2 in Status: SUCCESS [ 969.227473] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99327ed1-6c09-451a-b316-eb0268988db2 deletion is rescheduled due to dependency. [ 969.227623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.383073] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('721fd3df-fecb-47e7-86f0-25de8502794c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.838198] env[65359]: INFO networking_nsxv3.common.synchronization [None req-3e43f623-3f89-4d22-a4c3-34862e9bda4b tempest-AttachVolumeTestJSON-1956829346 tempest-AttachVolumeTestJSON-1956829346-project-member] Enqueued Resource ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 with Priority: HIGHEST for action security_group_rules [ 969.838198] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 with Priority: HIGHEST for action security_group_rules [ 969.838198] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.838198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.838198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.839021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.839207] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e88dc066-ae5f-45ff-a0ca-c16383ec5af9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.886279] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.886649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.886649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.887356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.887465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.887573] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 721fd3df-fecb-47e7-86f0-25de8502794c is going to be created. [ 969.912640] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.912840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.912840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.913522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.913522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.924635] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 721fd3df-fecb-47e7-86f0-25de8502794c in Status: UNINITIALIZED for 2s [ 969.934130] env[65359]: INFO networking_nsxv3.common.synchronization [None req-03d99c7b-302f-4df4-b242-1b9925c48e4f tempest-AttachVolumeTestJSON-1956829346 tempest-AttachVolumeTestJSON-1956829346-project-member] Enqueued Resource ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 with Priority: HIGHEST for action security_group_rules [ 969.934799] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 with Priority: HIGHEST for action security_group_rules [ 969.935062] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.935166] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.164270] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 970.164419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.164547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.164753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.164968] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.165123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.165207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.165330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.165429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.165499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.165575] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.365445] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.365767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.365767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.366052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.366227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.366320] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 already deleted. [ 970.366542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.366659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.367186] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.367186] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e88dc066-ae5f-45ff-a0ca-c16383ec5af9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.667937] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.668200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.668555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.668719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.668816] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.668958] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.669069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.669281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.669413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.669535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.669747] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.669882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.669976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.670207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.670407] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.670539] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.670632] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.670829] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.670967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.671074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.671211] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.893286] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.893816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.893816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.893816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.894083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.894147] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 already deleted. [ 970.894426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.173714] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3: rpc.has_security_group_logging(os_id): False [ 971.195497] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.195704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.195806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.195968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.196145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.196369] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.196473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.196536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.196699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.196781] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.196975] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.197121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.197169] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.197300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.197381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.197576] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.197669] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.197726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.197864] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.197936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.198204] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be updated. [ 971.287939] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.287939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.287939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.287939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.287939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.317740] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 2s [ 971.404308] env[65359]: INFO networking_nsxv3.common.synchronization [None req-6600373c-1221-49b2-94d5-980854c15f02 tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 971.405381] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 971.405686] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.405845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.405881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.406094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.406232] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.406328] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.406408] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.407012] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.407012] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.407012] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.908942] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.935978] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 721fd3df-fecb-47e7-86f0-25de8502794c in Status: SUCCESS [ 971.936364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.936364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.936596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.936788] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.936901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.936955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.937159] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.937204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.937293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.937378] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('721fd3df-fecb-47e7-86f0-25de8502794c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.412021] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.439385] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-721fd3df-fecb-47e7-86f0-25de8502794c taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.439467] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.439502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.439716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.439881] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.440023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.440084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.440209] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.440296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.440379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.440527] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-721fd3df-fecb-47e7-86f0-25de8502794c taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.440646] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.440689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.440802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.440937] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.441068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.441128] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.441273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.441348] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.441430] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.441524] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('721fd3df-fecb-47e7-86f0-25de8502794c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.691023] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8421d9a-13c9-4770-98c6-ba2736e91239 req-6c059cc1-62e4-487c-99e1-7463d02ae037 tempest-MultipleCreateTestJSON-875568090 tempest-MultipleCreateTestJSON-875568090-project-member] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 972.691584] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 972.691918] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.692058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.692132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.692434] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.692588] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.692691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.692794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.692933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.693047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.693146] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.914720] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.915493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.915493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.915493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.915493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.915668] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be updated. [ 972.944159] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 721fd3df-fecb-47e7-86f0-25de8502794c: rpc.has_security_group_logging(os_id): False [ 972.952158] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.952303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.952373] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.952615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.952754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.963334] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.963536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.964399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.964399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.964510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.964915] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.965115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.965219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.965449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.965536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.965775] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.965878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.965938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.966101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.966173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.966359] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.969021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.969021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.969021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.969021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.969021] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 721fd3df-fecb-47e7-86f0-25de8502794c is going to be created. [ 972.969021] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 2s [ 972.993990] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.993990] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.993990] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.994312] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.994547] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.994706] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.994821] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.995059] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.995710] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.995710] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.995710] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.995710] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.995710] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.995935] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.995935] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.996086] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.015768] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.015938] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 973.016093] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.016283] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.016600] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-b44389d6-6499-4668-a80c-12af7fcf2cf7 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.016840] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-b44389d6-6499-4668-a80c-12af7fcf2cf7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.016909] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-b44389d6-6499-4668-a80c-12af7fcf2cf7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.017236] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-b44389d6-6499-4668-a80c-12af7fcf2cf7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.017377] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b44389d6-6499-4668-a80c-12af7fcf2cf7',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.046796] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.046960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.047015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.047265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.047511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.062012] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 721fd3df-fecb-47e7-86f0-25de8502794c in Status: IN_PROGRESS for 2s [ 973.195205] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.195403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.195477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.195703] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.195910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.196075] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.196256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.196286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.196463] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.196496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.196578] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 already deleted. [ 973.196658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.336060] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 973.336268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.520331] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.520646] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.520879] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.521475] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.521703] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.521971] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port b44389d6-6499-4668-a80c-12af7fcf2cf7 not found, creating... [ 973.522460] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.522746] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.522896] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.523313] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.523472] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.523912] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.524122] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.524288] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.524546] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.524728] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.524882] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: b44389d6-6499-4668-a80c-12af7fcf2cf7 is going to be created. [ 973.552106] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.552450] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.552528] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.552877] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.553381] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.553992] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-b44389d6-6499-4668-a80c-12af7fcf2cf7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.851468] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.851667] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.851790] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.852068] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.852590] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.852776] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.852892] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.853174] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.853315] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.853521] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.853627] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.854146] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.854146] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.854146] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.854146] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.854394] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.871849] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.872061] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 973.872308] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.872518] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.872826] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-9d769986-14b3-43bc-9b54-182b2881660a taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.873061] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-9d769986-14b3-43bc-9b54-182b2881660a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.873192] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-9d769986-14b3-43bc-9b54-182b2881660a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.873490] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-9d769986-14b3-43bc-9b54-182b2881660a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.873624] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d769986-14b3-43bc-9b54-182b2881660a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.249282] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8421d9a-13c9-4770-98c6-ba2736e91239 req-78647c29-ef94-4ab6-879d-f6e473269186 service nova] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_rules [ 974.249573] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8421d9a-13c9-4770-98c6-ba2736e91239 req-78647c29-ef94-4ab6-879d-f6e473269186 service nova] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 974.249829] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8421d9a-13c9-4770-98c6-ba2736e91239 req-78647c29-ef94-4ab6-879d-f6e473269186 service nova] Enqueued Resource ID: b44389d6-6499-4668-a80c-12af7fcf2cf7 with Priority: HIGHEST for action port [ 974.250682] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_rules [ 974.250827] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 974.251013] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b44389d6-6499-4668-a80c-12af7fcf2cf7 with Priority: HIGHEST for action port [ 974.251346] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.251469] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.251538] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.251805] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.251937] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.253539] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.253653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.253697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.253860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.254149] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.254279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.254355] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.254553] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.254643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.254734] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.255688] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-b44389d6-6499-4668-a80c-12af7fcf2cf7 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.255807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b44389d6-6499-4668-a80c-12af7fcf2cf7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.255876] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b44389d6-6499-4668-a80c-12af7fcf2cf7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.256056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b44389d6-6499-4668-a80c-12af7fcf2cf7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.256138] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b44389d6-6499-4668-a80c-12af7fcf2cf7',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.376545] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.376545] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.376545] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.376847] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.376953] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.377125] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 9d769986-14b3-43bc-9b54-182b2881660a not found, creating... [ 974.377390] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.377551] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.377667] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.377877] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.378034] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.378428] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.378835] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.378835] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.378954] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.379119] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.379276] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 9d769986-14b3-43bc-9b54-182b2881660a is going to be created. [ 974.401384] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.401605] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.401729] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.402046] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.402307] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.402532] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-9d769986-14b3-43bc-9b54-182b2881660a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.754028] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.754215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.757696] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.760704] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b44389d6-6499-4668-a80c-12af7fcf2cf7 with status ACTIVE [ 974.760905] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.760992] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.761095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.761493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.761571] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.761816] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.761973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.762093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.762488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.762488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.763015] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.763015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.763197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.763292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.763422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.763574] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b44389d6-6499-4668-a80c-12af7fcf2cf7 is going to be updated. [ 974.790182] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.790369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.790413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.790902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.791079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.791274] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b44389d6-6499-4668-a80c-12af7fcf2cf7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.981442] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 974.981582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.076641] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 721fd3df-fecb-47e7-86f0-25de8502794c in Status: SUCCESS [ 975.076738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.125947] env[65359]: INFO networking_nsxv3.common.synchronization [req-9d84fa7c-a9cf-4bd1-a049-9bf7ccdc399a req-546295b4-5761-49df-a53c-cbc020ede85d service nova] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_rules [ 975.127227] env[65359]: INFO networking_nsxv3.common.synchronization [req-9d84fa7c-a9cf-4bd1-a049-9bf7ccdc399a req-546295b4-5761-49df-a53c-cbc020ede85d service nova] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 975.127928] env[65359]: INFO networking_nsxv3.common.synchronization [req-9d84fa7c-a9cf-4bd1-a049-9bf7ccdc399a req-546295b4-5761-49df-a53c-cbc020ede85d service nova] Enqueued Resource ID: 9d769986-14b3-43bc-9b54-182b2881660a with Priority: HIGHEST for action port [ 975.129105] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_rules [ 975.129105] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 975.129105] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d769986-14b3-43bc-9b54-182b2881660a with Priority: HIGHEST for action port [ 975.131120] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.131265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.131265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.131701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.131763] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.133241] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.133415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.133460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.133689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.133852] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.133963] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.137753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.138322] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.138322] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.138322] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.141074] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d769986-14b3-43bc-9b54-182b2881660a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.141220] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d769986-14b3-43bc-9b54-182b2881660a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.141279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d769986-14b3-43bc-9b54-182b2881660a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.141503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d769986-14b3-43bc-9b54-182b2881660a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.141613] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d769986-14b3-43bc-9b54-182b2881660a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.263400] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.418840] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8421d9a-13c9-4770-98c6-ba2736e91239 req-46485f4f-1512-4c5b-85d4-3add8d08e186 tempest-MultipleCreateTestJSON-875568090 tempest-MultipleCreateTestJSON-875568090-project-member] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 975.419553] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 975.419885] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.419993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.643751] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.643913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.644201] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.645133] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d769986-14b3-43bc-9b54-182b2881660a with status ACTIVE [ 975.645399] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.645488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.645540] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.645753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.645933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.646115] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.646226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.646301] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.646629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.646716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.646957] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.647028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.647072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.647187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.647263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.647571] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d769986-14b3-43bc-9b54-182b2881660a is going to be updated. [ 975.670743] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.670905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.671026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.671263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.671407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.671576] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d769986-14b3-43bc-9b54-182b2881660a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.766379] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.766583] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.766708] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.766961] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.767231] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.767385] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.767499] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.767710] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.767885] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.769142] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 975.769142] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 975.769142] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 975.769142] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 975.769142] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 975.769142] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 975.769142] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 975.769883] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.770012] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.770082] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.770246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.770317] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.770409] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be created. [ 975.804700] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 975.805110] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 975.805110] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 975.806191] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.806191] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-c2fe7ed5-f8be-4810-a42b-676132b21a99 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.806191] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-c2fe7ed5-f8be-4810-a42b-676132b21a99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.806191] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-c2fe7ed5-f8be-4810-a42b-676132b21a99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.806191] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-c2fe7ed5-f8be-4810-a42b-676132b21a99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.806543] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2fe7ed5-f8be-4810-a42b-676132b21a99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.818405] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.818572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.818664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.819120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.820077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.840124] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: UNINITIALIZED for 2s [ 976.149783] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.309425] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.309830] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.309975] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.310764] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.311050] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.311352] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port c2fe7ed5-f8be-4810-a42b-676132b21a99 not found, creating... [ 976.311837] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.312155] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.312400] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.312738] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.312900] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.313289] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.313480] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.313619] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.313865] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.314037] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.314210] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: c2fe7ed5-f8be-4810-a42b-676132b21a99 is going to be created. [ 976.342472] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.343293] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.343293] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.343877] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.344154] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.344408] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-c2fe7ed5-f8be-4810-a42b-676132b21a99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.652156] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.652344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.652418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.652627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.652719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.652818] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be updated. [ 976.683814] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.684021] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.684216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.684564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.684723] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.694916] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 2s [ 977.026442] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8421d9a-13c9-4770-98c6-ba2736e91239 req-651ea77b-b346-4157-9fb5-95ed0909bc09 service nova] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_rules [ 977.026442] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8421d9a-13c9-4770-98c6-ba2736e91239 req-651ea77b-b346-4157-9fb5-95ed0909bc09 service nova] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 977.026442] env[65359]: INFO networking_nsxv3.common.synchronization [req-f8421d9a-13c9-4770-98c6-ba2736e91239 req-651ea77b-b346-4157-9fb5-95ed0909bc09 service nova] Enqueued Resource ID: c2fe7ed5-f8be-4810-a42b-676132b21a99 with Priority: HIGHEST for action port [ 977.027631] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_rules [ 977.027631] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 977.027631] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2fe7ed5-f8be-4810-a42b-676132b21a99 with Priority: HIGHEST for action port [ 977.027631] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.027631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.028014] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.028014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.028250] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2fe7ed5-f8be-4810-a42b-676132b21a99 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.028361] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2fe7ed5-f8be-4810-a42b-676132b21a99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.028429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2fe7ed5-f8be-4810-a42b-676132b21a99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.028703] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2fe7ed5-f8be-4810-a42b-676132b21a99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.028805] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2fe7ed5-f8be-4810-a42b-676132b21a99',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.533783] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2fe7ed5-f8be-4810-a42b-676132b21a99 with status ACTIVE [ 977.533783] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.533783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.533783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.533783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.533783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.533783] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.533783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.533783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.533783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.533783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.533783] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.533783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.533783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.533783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.533783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.533783] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2fe7ed5-f8be-4810-a42b-676132b21a99 is going to be updated. [ 977.556823] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.557037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.557122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.557339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.557522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.558334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2fe7ed5-f8be-4810-a42b-676132b21a99" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.850144] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 977.850144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.850292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.850509] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.850701] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.850818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.850886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.851044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.851123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.851212] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.851333] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.852280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.852280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.852440] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.852541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.852601] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.852822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.852933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.853077] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.858036] env[65359]: INFO networking_nsxv3.common.synchronization [req-fa34c056-f736-4f14-8e83-fa94d596b94e req-8527dea3-7ed6-45cf-9011-46897110484f tempest-ServersNegativeTestJSON-839733669 tempest-ServersNegativeTestJSON-839733669-project-member] Enqueued Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_members [ 977.859085] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_members [ 977.859085] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.859085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.859085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.859303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.859603] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.859603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.859603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.859717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.859817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.859880] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.181767] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.181969] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-376" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.182109] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-376" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.182654] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-376" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.182728] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.182995] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.184794] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.184794] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.184794] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.184794] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.184794] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.184794] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.184794] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.184794] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.184794] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.185227] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.207517] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.207717] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 978.207865] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.208097] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-376" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.208463] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-8a7575cb-1178-4065-a543-a453c30bb1d9 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.208679] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.208804] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.209179] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.209338] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a7575cb-1178-4065-a543-a453c30bb1d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.354525] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.354776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.355416] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.365261] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.365499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.365600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.366020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.366109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.366368] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.366497] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.366578] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.366796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.366919] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.366968] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31844aa-4ad6-4249-8902-93e89324b0b5 already deleted. [ 978.368969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.707737] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 978.708221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.708221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.708375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.708537] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.708899] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.708899] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.708899] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.709030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.709030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.709129] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.712136] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.712349] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.712514] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.712832] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.713061] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.713298] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 8a7575cb-1178-4065-a543-a453c30bb1d9 not found, creating... [ 978.713622] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.714264] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.714264] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.714449] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.714488] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.715444] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.715444] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.715444] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.715637] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.716078] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.716187] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 8a7575cb-1178-4065-a543-a453c30bb1d9 is going to be created. [ 978.747538] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.747768] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.747893] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.748435] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.748522] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.748729] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.857733] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.213070] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.213277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.213361] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.213579] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.213802] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.213931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.214016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.214200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.214292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.214377] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.214565] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.214663] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.214767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.214964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.215170] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.215333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.215428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.215618] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.215709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.215794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.215903] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.360849] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.360849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.360849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.361105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.361105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.361181] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be updated. [ 979.393804] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.393804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.393804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.394153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.394153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.404324] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: IN_PROGRESS for 2s [ 979.508307] env[65359]: INFO networking_nsxv3.common.synchronization [req-fa34c056-f736-4f14-8e83-fa94d596b94e req-5c071f7a-17d2-4a95-a514-51562101281b service nova] Enqueued Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_rules [ 979.508358] env[65359]: INFO networking_nsxv3.common.synchronization [req-fa34c056-f736-4f14-8e83-fa94d596b94e req-5c071f7a-17d2-4a95-a514-51562101281b service nova] Enqueued Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_members [ 979.508456] env[65359]: INFO networking_nsxv3.common.synchronization [req-fa34c056-f736-4f14-8e83-fa94d596b94e req-5c071f7a-17d2-4a95-a514-51562101281b service nova] Enqueued Resource ID: 8a7575cb-1178-4065-a543-a453c30bb1d9 with Priority: HIGHEST for action port [ 979.508966] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_rules [ 979.509138] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_members [ 979.509239] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a7575cb-1178-4065-a543-a453c30bb1d9 with Priority: HIGHEST for action port [ 979.509508] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.509630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.509707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.509939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.510253] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.511966] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.512105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.512176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.512388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.512550] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.512655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.512717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.512873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.512958] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.513113] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.513924] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a7575cb-1178-4065-a543-a453c30bb1d9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.514056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.514056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.514211] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.514282] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a7575cb-1178-4065-a543-a453c30bb1d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.719198] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3: rpc.has_security_group_logging(os_id): False [ 979.759946] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.759946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.759946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.760152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.760187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.761081] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.761081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.761081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.761081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.761081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.761322] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.761322] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.761396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.761494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.761563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.761747] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.761838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.761896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.762344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.762483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.762609] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be updated. [ 979.861697] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.861697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.861697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.861697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.861881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.880692] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 2s [ 980.013237] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.013463] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.015846] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.016877] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a7575cb-1178-4065-a543-a453c30bb1d9 with status ACTIVE [ 980.017117] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.017256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.017361] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.017594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.017683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.017872] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.017975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.018070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.018270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.018348] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.018580] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.018681] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.018743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.018883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.018959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.019058] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a7575cb-1178-4065-a543-a453c30bb1d9 is going to be updated. [ 980.047347] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.048386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.048386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.048386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.048386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.048386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.521686] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.025186] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.025510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.025651] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.025980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.026188] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.026361] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31844aa-4ad6-4249-8902-93e89324b0b5 is going to be created. [ 981.060970] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.061312] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.061312] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.061493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.062125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.074917] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: UNINITIALIZED for 2s [ 981.417900] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 981.418085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.418374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.418470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.418633] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.418756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.418824] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.418982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.419206] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.419206] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.902067] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 981.902067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.925146] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.431391] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.521429] env[65359]: INFO networking_nsxv3.common.synchronization [req-4d691788-93bd-49e4-9e40-d3142ba33f95 req-791d3208-ee4e-4843-a063-8306fbb35287 tempest-ServerDiagnosticsNegativeTest-432914707 tempest-ServerDiagnosticsNegativeTest-432914707-project-member] Enqueued Resource ID: 721fd3df-fecb-47e7-86f0-25de8502794c with Priority: HIGHEST for action security_group_members [ 982.525431] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 721fd3df-fecb-47e7-86f0-25de8502794c with Priority: HIGHEST for action security_group_members [ 982.525949] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-721fd3df-fecb-47e7-86f0-25de8502794c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.526191] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.526347] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.526813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.526813] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.526960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.527023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.527159] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.527265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.527339] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('721fd3df-fecb-47e7-86f0-25de8502794c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.934709] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.934966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.935107] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.935432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.935596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.935763] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be updated. [ 982.973294] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.973494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.973494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.973706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.973844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.986297] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: IN_PROGRESS for 2s [ 983.030116] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.030254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.030323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.030585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.030670] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.030968] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.031097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.031191] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.031372] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.031511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.032554] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 721fd3df-fecb-47e7-86f0-25de8502794c is going to be updated. [ 983.062495] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.062733] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.062969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.063149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.063232] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.073361] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 721fd3df-fecb-47e7-86f0-25de8502794c in Status: IN_PROGRESS for 2s [ 983.085673] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: SUCCESS [ 983.085902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.086084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.086322] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.086515] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.086636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.086700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.086857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.086964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.087024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.087151] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.592488] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.592488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.592488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.592488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.592488] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.592488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.592488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.592488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.592488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.592488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.592488] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.592488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.592488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.592488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.592488] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.592488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.593302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.593302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.593302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.594058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.594058] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.097228] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a31844aa-4ad6-4249-8902-93e89324b0b5: rpc.has_security_group_logging(os_id): False [ 984.119667] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.119667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.119667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.120026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.120107] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.120511] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.121034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.121034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.121034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.121034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.121642] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.121642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.121642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.121642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.121786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.122027] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.122135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.122277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.122316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.122401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.122908] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a31844aa-4ad6-4249-8902-93e89324b0b5 is going to be created. [ 984.196145] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.196384] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.196384] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.196567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.196691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.208064] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: IN_PROGRESS for 2s [ 984.999925] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 985.000293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.000491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.000682] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.000948] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.001349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.001349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.001474] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.001474] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.001563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.001804] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.002256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.002256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.002256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.002399] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.002399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.002476] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.003064] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.003064] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.003064] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.003064] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.091749] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 721fd3df-fecb-47e7-86f0-25de8502794c in Status: SUCCESS [ 985.091749] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 721fd3df-fecb-47e7-86f0-25de8502794c deletion is rescheduled due to dependency. [ 985.091749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.505823] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4589a5a7-4543-448d-9e0a-cd5d1c274131: rpc.has_security_group_logging(os_id): False [ 985.527062] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.527296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.527393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.527634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.528599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.528599] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.528599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.528599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.528599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.528599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.529086] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.529086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.529086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.533308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.533532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.534029] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.534029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.534029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.534261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.534343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.534438] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be created. [ 985.601477] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.601717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.601804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.602070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.602289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.619246] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: IN_PROGRESS for 2s [ 986.224606] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: SUCCESS [ 986.224606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.529504] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 987.530424] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 987.639042] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 987.639314] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.639516] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.639755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.639863] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.146842] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.146842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.146842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.146842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.146842] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.146842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.147351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.147351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.147351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.147508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.147702] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.539986] env[65359]: INFO networking_nsxv3.common.synchronization [req-de3eea93-72da-4c6b-a7ec-0e4293b350b9 req-ae248d65-3613-4e6a-baa5-6ba7318520fe tempest-ImagesTestJSON-1497561183 tempest-ImagesTestJSON-1497561183-project-member] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 988.541988] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 988.542384] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.542514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.542575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.542782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.542937] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.543046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.543149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.543312] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.543400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.543496] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.652521] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.652705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.652768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.652972] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.653208] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.653310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.653377] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.653538] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.653639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.653685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.653829] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.653920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.653984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.654154] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.654321] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.654417] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.654469] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.654607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.654680] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.654761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.654847] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.015634] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-189 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.015634] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.016538] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.016848] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.017319] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.018073] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.018073] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.018273] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.018341] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.018613] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.019224] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.019224] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.019224] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.019354] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.019404] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.019578] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.044066] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.044305] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 989.044434] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.045130] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-189" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.045130] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-072687b9-54dd-49a2-8c90-16a5a598ad73 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.045468] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-072687b9-54dd-49a2-8c90-16a5a598ad73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.045570] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-072687b9-54dd-49a2-8c90-16a5a598ad73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.045924] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-072687b9-54dd-49a2-8c90-16a5a598ad73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.046107] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('072687b9-54dd-49a2-8c90-16a5a598ad73',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.047538] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.047538] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.047538] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.047750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.047750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.047829] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.047926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.048057] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.048166] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.048214] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.048296] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 989.081684] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.081971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.081971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.082131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.082275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.094288] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 989.156830] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4589a5a7-4543-448d-9e0a-cd5d1c274131: rpc.has_security_group_logging(os_id): False [ 989.178232] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.178546] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.178681] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.178956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.179092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.179428] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.179570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.179633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.179832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.179957] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.180217] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.180327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.180474] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.180628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.180726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.180935] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.181196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.181196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.181404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.181493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.181576] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be updated. [ 989.283846] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.284050] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.284139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.284525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.284698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.303043] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: IN_PROGRESS for 2s [ 989.550679] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.551056] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.551149] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.551503] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.551652] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.551814] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 072687b9-54dd-49a2-8c90-16a5a598ad73 not found, creating... [ 989.552128] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.552411] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.553244] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.553244] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.553244] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.553416] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.553551] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.553704] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.553957] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.554162] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.554332] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 072687b9-54dd-49a2-8c90-16a5a598ad73 is going to be created. [ 989.578713] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.578971] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.579086] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.579359] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.579580] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.579801] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-072687b9-54dd-49a2-8c90-16a5a598ad73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.298210] env[65359]: INFO networking_nsxv3.common.synchronization [req-de3eea93-72da-4c6b-a7ec-0e4293b350b9 req-a6d376a1-098f-42d7-a110-7e24d8c1cfc0 service nova] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_rules [ 990.298365] env[65359]: INFO networking_nsxv3.common.synchronization [req-de3eea93-72da-4c6b-a7ec-0e4293b350b9 req-a6d376a1-098f-42d7-a110-7e24d8c1cfc0 service nova] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 990.298506] env[65359]: INFO networking_nsxv3.common.synchronization [req-de3eea93-72da-4c6b-a7ec-0e4293b350b9 req-a6d376a1-098f-42d7-a110-7e24d8c1cfc0 service nova] Enqueued Resource ID: 072687b9-54dd-49a2-8c90-16a5a598ad73 with Priority: HIGHEST for action port [ 990.299478] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_rules [ 990.299916] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 990.299916] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 072687b9-54dd-49a2-8c90-16a5a598ad73 with Priority: HIGHEST for action port [ 990.300070] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.300231] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.300290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.300547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.300592] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.301486] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.302102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.302102] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-072687b9-54dd-49a2-8c90-16a5a598ad73 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.302102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-072687b9-54dd-49a2-8c90-16a5a598ad73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.302102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-072687b9-54dd-49a2-8c90-16a5a598ad73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.302297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-072687b9-54dd-49a2-8c90-16a5a598ad73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.302297] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('072687b9-54dd-49a2-8c90-16a5a598ad73',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.612760] env[65359]: INFO networking_nsxv3.common.synchronization [None req-947ea7da-a299-4fd4-b496-580c509024e5 None None] Enqueued Resource ID: 97d34454-f50c-470d-b03e-27c4a89c1a90 with Priority: HIGHEST for action port [ 990.612950] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97d34454-f50c-470d-b03e-27c4a89c1a90 with Priority: HIGHEST for action port [ 990.613309] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-97d34454-f50c-470d-b03e-27c4a89c1a90 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.613442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97d34454-f50c-470d-b03e-27c4a89c1a90" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.613487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97d34454-f50c-470d-b03e-27c4a89c1a90" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.613906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97d34454-f50c-470d-b03e-27c4a89c1a90" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.614048] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97d34454-f50c-470d-b03e-27c4a89c1a90',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.632864] env[65359]: INFO networking_nsxv3.common.synchronization [req-a4ead45d-db06-4361-a004-916a61d79f76 req-af4b9244-0b69-4de9-bffb-2072ffbb17f5 tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 990.633748] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 990.634313] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.634313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.634313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.634313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.634529] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.634571] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.634713] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.634783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.634840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.634937] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.805635] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.805768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.806023] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 072687b9-54dd-49a2-8c90-16a5a598ad73 with status ACTIVE [ 990.806203] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.806322] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.806383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.806597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.806706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.806882] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.806977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.807073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.807288] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.807288] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.807739] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.807853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.807915] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.808079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.808167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.808255] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 072687b9-54dd-49a2-8c90-16a5a598ad73 is going to be updated. [ 990.836984] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.837221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.837355] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.837624] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.837700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.838099] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-072687b9-54dd-49a2-8c90-16a5a598ad73" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.104913] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 991.105115] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 deletion is rescheduled due to dependency. [ 991.105412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.105412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.108251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.108251] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.108251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.108251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.108251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.108251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.108251] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.117358] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97d34454-f50c-470d-b03e-27c4a89c1a90 [ 991.117795] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.117869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.117935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.118169] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.118231] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.118332] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97d34454-f50c-470d-b03e-27c4a89c1a90 already deleted. [ 991.119268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97d34454-f50c-470d-b03e-27c4a89c1a90" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.137586] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.320639] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 991.320907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.609401] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.642506] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.957061] env[65359]: INFO networking_nsxv3.common.synchronization [None req-071c8818-0cd1-4d41-ab9f-4b20aaddeecf tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 991.957653] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 991.957972] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.958398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.116238] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.150381] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.150381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.150381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.150381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.150381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.150381] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be updated. [ 992.177551] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.177743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.177867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.178846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.178846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.190018] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 2s [ 992.378333] env[65359]: INFO networking_nsxv3.common.synchronization [req-10d9a18c-e58d-4fe9-8305-7f212f51dffb req-034c5f76-4da9-4f4b-af72-ef74362afe42 tempest-MultipleCreateTestJSON-875568090 tempest-MultipleCreateTestJSON-875568090-project-member] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 992.378974] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 992.379405] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.379518] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.379518] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.379779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.379885] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.380049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.380115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.380359] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.380409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.380495] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.579761] env[65359]: INFO networking_nsxv3.common.synchronization [req-913c2d7f-ca42-402b-9030-141593f85c31 req-ad414eaf-ee9b-468a-a1f5-d8612cd9c617 tempest-MultipleCreateTestJSON-875568090 tempest-MultipleCreateTestJSON-875568090-project-member] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 992.580611] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 992.580948] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.581149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.621196] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.621196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.621196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.621196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.621196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.621196] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 992.653973] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.654521] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.654521] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.654521] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.654672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.669786] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 992.884047] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.961166] env[65359]: INFO networking_nsxv3.common.synchronization [None req-d1b8062a-5ba7-44b2-9bc0-b6c3f6e307b4 None None] Enqueued Resource ID: e68ee61d-f547-4202-b8d6-057e311a41f6 with Priority: HIGHEST for action port [ 992.961166] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e68ee61d-f547-4202-b8d6-057e311a41f6 with Priority: HIGHEST for action port [ 992.962619] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-e68ee61d-f547-4202-b8d6-057e311a41f6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.963335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e68ee61d-f547-4202-b8d6-057e311a41f6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.963335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e68ee61d-f547-4202-b8d6-057e311a41f6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.963602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e68ee61d-f547-4202-b8d6-057e311a41f6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.963749] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e68ee61d-f547-4202-b8d6-057e311a41f6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.224356] env[65359]: INFO networking_nsxv3.common.synchronization [req-937e07fd-db66-468a-ace1-a95615958c03 req-b1b4815b-e541-442a-b610-6e11ad523b7a tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGHEST for action security_group_members [ 993.224878] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGHEST for action security_group_members [ 993.225197] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0a461a8-ce41-468d-b9bb-19fef2690b98 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.225332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.225396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.225642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.225797] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.225896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.225953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.226121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.226210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.226301] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0a461a8-ce41-468d-b9bb-19fef2690b98',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.386804] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.467835] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e68ee61d-f547-4202-b8d6-057e311a41f6 [ 993.468124] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.468307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.468498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.468827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.468941] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.469157] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e68ee61d-f547-4202-b8d6-057e311a41f6 already deleted. [ 993.469298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e68ee61d-f547-4202-b8d6-057e311a41f6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.730824] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.731145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.731221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.731709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.731709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.731817] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.731875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.732325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.732563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.732668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.732747] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 already deleted. [ 993.732834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.800028] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.800028] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.800028] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.800028] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.800028] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.800608] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.800876] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.801247] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.801557] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.801883] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.802835] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.802835] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.802835] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.802835] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.802835] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.803080] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.827652] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.827826] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 993.827976] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.828234] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.828510] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-1dbe5724-a4ed-4c7c-ad62-3972791eac6f taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.828709] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-1dbe5724-a4ed-4c7c-ad62-3972791eac6f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.828815] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-1dbe5724-a4ed-4c7c-ad62-3972791eac6f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.829473] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-1dbe5724-a4ed-4c7c-ad62-3972791eac6f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.829710] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dbe5724-a4ed-4c7c-ad62-3972791eac6f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.890292] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.890445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.890514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.890720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.890827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.890931] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be updated. [ 993.927353] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.927490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.927564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.927790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.927963] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.938576] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: IN_PROGRESS for 2s [ 994.201322] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 994.201411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.201593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.201794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.201983] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.202122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.202207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.202394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.202529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.202639] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.332521] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.332805] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.332953] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.333359] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.333528] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.333791] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 1dbe5724-a4ed-4c7c-ad62-3972791eac6f not found, creating... [ 994.334026] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.334194] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.334639] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.334936] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.335118] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.335670] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.335950] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.336096] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.336367] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.336534] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.336723] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 1dbe5724-a4ed-4c7c-ad62-3972791eac6f is going to be created. [ 994.362754] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.363056] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.365122] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.365122] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.365278] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.365672] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-1dbe5724-a4ed-4c7c-ad62-3972791eac6f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.684589] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 994.684818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.685014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.685303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.685502] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.685620] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.685682] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.685842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.685932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.686032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.686127] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.706017] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.706017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.706017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.706017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.706017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.706017] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.706017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.706017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.706342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.706342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.706342] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be updated. [ 994.748016] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.748420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.748420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.748742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.748905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.762443] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 2s [ 995.116526] env[65359]: INFO networking_nsxv3.common.synchronization [req-937e07fd-db66-468a-ace1-a95615958c03 req-6f87c81f-d52c-4ead-b1f6-1170a41c0092 service nova] Enqueued Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGHEST for action security_group_rules [ 995.116798] env[65359]: INFO networking_nsxv3.common.synchronization [req-937e07fd-db66-468a-ace1-a95615958c03 req-6f87c81f-d52c-4ead-b1f6-1170a41c0092 service nova] Enqueued Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGHEST for action security_group_members [ 995.116870] env[65359]: INFO networking_nsxv3.common.synchronization [req-937e07fd-db66-468a-ace1-a95615958c03 req-6f87c81f-d52c-4ead-b1f6-1170a41c0092 service nova] Enqueued Resource ID: 1dbe5724-a4ed-4c7c-ad62-3972791eac6f with Priority: HIGHEST for action port [ 995.117351] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGHEST for action security_group_rules [ 995.117576] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGHEST for action security_group_members [ 995.117576] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dbe5724-a4ed-4c7c-ad62-3972791eac6f with Priority: HIGHEST for action port [ 995.117846] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0a461a8-ce41-468d-b9bb-19fef2690b98 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.117955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.118499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.119435] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.119531] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0a461a8-ce41-468d-b9bb-19fef2690b98',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.120901] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0a461a8-ce41-468d-b9bb-19fef2690b98 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.121044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.121130] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.121325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.121495] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.121590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.121663] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.121787] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.121868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.121953] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0a461a8-ce41-468d-b9bb-19fef2690b98',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.122718] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dbe5724-a4ed-4c7c-ad62-3972791eac6f taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.122816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dbe5724-a4ed-4c7c-ad62-3972791eac6f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.122907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dbe5724-a4ed-4c7c-ad62-3972791eac6f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.123045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dbe5724-a4ed-4c7c-ad62-3972791eac6f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.123101] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dbe5724-a4ed-4c7c-ad62-3972791eac6f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.188714] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.188714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.188714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.188714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.188966] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.188966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.188966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.189109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.190032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.190032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.190032] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.190032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.190032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.190032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.190474] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.190582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.190646] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.190793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.190871] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.190955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.191065] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.193446] env[65359]: INFO networking_nsxv3.common.synchronization [req-6971db4b-0599-48e4-b5e3-cc7a97dda467 req-4ab5f1a8-c15d-443f-be80-659b84d01a03 tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 with Priority: HIGHEST for action security_group_members [ 995.194059] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 with Priority: HIGHEST for action security_group_members [ 995.194347] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.194437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.194504] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.194705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.194859] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.195053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.195053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.195179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.195259] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.195346] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bbf694f-ad41-4969-a7b8-1248ccdf3fa1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.624828] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0a461a8-ce41-468d-b9bb-19fef2690b98',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.625883] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0a461a8-ce41-468d-b9bb-19fef2690b98 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.626012] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.626162] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1dbe5724-a4ed-4c7c-ad62-3972791eac6f with status ACTIVE [ 995.626321] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.626665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.626665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.626665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.626902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.626902] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.626997] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.627055] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.627209] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.627306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.627460] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.627556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.627606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.627739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.627810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.627889] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1dbe5724-a4ed-4c7c-ad62-3972791eac6f is going to be updated. [ 995.651267] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.651510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.651510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.651811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.651898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.652051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dbe5724-a4ed-4c7c-ad62-3972791eac6f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.694587] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28737c44-388f-4cb8-9cac-0181cbb28981: rpc.has_security_group_logging(os_id): False [ 995.697742] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.697886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.697967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.698155] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.705667] env[65359]: INFO networking_nsxv3.common.synchronization [req-a84b37c8-a838-46b2-81e5-9ada3de54f5d req-b0c5ee9f-c9f6-461f-886e-420e49ec5122 tempest-ServersTestBootFromVolume-259238566 tempest-ServersTestBootFromVolume-259238566-project-member] Enqueued Resource ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d with Priority: HIGHEST for action security_group_members [ 995.706111] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d with Priority: HIGHEST for action security_group_members [ 995.706417] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a269c68-1fd7-4085-a1d3-54f407762a6d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.706540] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.706592] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.707098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.707098] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.707098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.707098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.707311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.707311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.707369] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a269c68-1fd7-4085-a1d3-54f407762a6d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.715307] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.715421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.717106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.717295] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.717295] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.717381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.717526] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.718196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.718647] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 is going to be updated. [ 995.719227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.720886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.720886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.720886] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.720886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.720886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.720886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.721124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.721124] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.721263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.721306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.721529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.721529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.721694] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.721782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.721782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.721944] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.722008] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.722094] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 995.776649] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.776649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.776649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.776649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.777066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.808743] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 in Status: IN_PROGRESS for 2s [ 995.821603] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.821793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.821793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.822696] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.822696] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.846707] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 995.950031] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 995.950289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.950463] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.953301] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.953529] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.953660] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.953739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.953916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.954011] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.954177] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.130185] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0a461a8-ce41-468d-b9bb-19fef2690b98',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.209460] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.209629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.209702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.209919] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.210330] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.210330] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.210485] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.210564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.210747] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.210870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.211093] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d is going to be updated. [ 996.240076] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.240076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.240299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.240522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.240719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.251964] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d in Status: IN_PROGRESS for 2s [ 996.457715] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.457994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.457994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.458187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.458280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.458483] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.458658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.458658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.458767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.458839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.458924] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be updated. [ 996.487159] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.487368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.487494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.487778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.487987] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.502786] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: IN_PROGRESS for 2s [ 996.633833] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.633996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.634093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.634309] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.634442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.634546] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 is going to be created. [ 996.672833] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.673076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.673159] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.673427] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.673641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.684377] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 in Status: UNINITIALIZED for 2s [ 996.774825] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 996.775010] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 deletion is rescheduled due to dependency. [ 996.775126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.820346] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 in Status: SUCCESS [ 997.820631] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbf694f-ad41-4969-a7b8-1248ccdf3fa1 deletion is rescheduled due to dependency. [ 997.820631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbf694f-ad41-4969-a7b8-1248ccdf3fa1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.863957] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 997.864272] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.261934] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d in Status: SUCCESS [ 998.262131] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d deletion is rescheduled due to dependency. [ 998.262239] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.513581] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 998.513827] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 deletion is rescheduled due to dependency. [ 998.513949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.696919] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 in Status: UNINITIALIZED for 4s [ 999.833819] env[65359]: INFO networking_nsxv3.common.synchronization [req-e5f3681e-53d5-48fc-b7fd-0d46ff7e5b3e req-4d65da97-b61e-4615-9b6d-39211697bc44 tempest-ServersTestJSON-1929866617 tempest-ServersTestJSON-1929866617-project-member] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 999.834398] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 999.834744] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.834865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.834956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.836743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.836966] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.837120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.837571] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.837795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.837936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.838065] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.220653] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.220844] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.220970] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.221245] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.221632] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.222028] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.222028] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.222255] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.222318] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.222522] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1000.225021] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.225021] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.225021] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.225021] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1000.225021] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.225021] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.247157] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.247360] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1000.247510] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.247689] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.248028] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-3faf10f0-61df-4680-b849-1713314dffcc taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.248212] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-3faf10f0-61df-4680-b849-1713314dffcc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.248330] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-3faf10f0-61df-4680-b849-1713314dffcc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.248651] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-3faf10f0-61df-4680-b849-1713314dffcc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.248789] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3faf10f0-61df-4680-b849-1713314dffcc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.340183] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.712170] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 in Status: SUCCESS [ 1000.713512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.713512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.713512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.713512] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.713512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.713783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.713821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.713902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.714894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.719273] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0a461a8-ce41-468d-b9bb-19fef2690b98',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.751267] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.754034] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.754034] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.754034] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.754034] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.754034] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 3faf10f0-61df-4680-b849-1713314dffcc not found, creating... [ 1000.754034] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.754034] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.754034] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.754034] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.754034] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.754523] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.754523] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.754523] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.754523] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.754523] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.754692] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 3faf10f0-61df-4680-b849-1713314dffcc is going to be created. [ 1000.776550] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.776954] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.776954] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.777178] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.777718] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.777962] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-3faf10f0-61df-4680-b849-1713314dffcc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.844291] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.221463] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0a461a8-ce41-468d-b9bb-19fef2690b98',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.348071] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.348071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.348071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.348238] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.348270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.348371] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 1001.381860] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.381860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.381860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.382132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.382169] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.395386] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 1001.544697] env[65359]: INFO networking_nsxv3.common.synchronization [req-e5f3681e-53d5-48fc-b7fd-0d46ff7e5b3e req-a02fa7d3-6220-4964-9f9e-09d4b671a1d8 service nova] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_rules [ 1001.544697] env[65359]: INFO networking_nsxv3.common.synchronization [req-e5f3681e-53d5-48fc-b7fd-0d46ff7e5b3e req-a02fa7d3-6220-4964-9f9e-09d4b671a1d8 service nova] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1001.544697] env[65359]: INFO networking_nsxv3.common.synchronization [req-e5f3681e-53d5-48fc-b7fd-0d46ff7e5b3e req-a02fa7d3-6220-4964-9f9e-09d4b671a1d8 service nova] Enqueued Resource ID: 3faf10f0-61df-4680-b849-1713314dffcc with Priority: HIGHEST for action port [ 1001.544697] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_rules [ 1001.544697] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1001.544697] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3faf10f0-61df-4680-b849-1713314dffcc with Priority: HIGHEST for action port [ 1001.545711] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.546043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.546319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.549019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.549019] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.549019] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.549019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.549019] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-3faf10f0-61df-4680-b849-1713314dffcc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.549019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3faf10f0-61df-4680-b849-1713314dffcc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.549019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3faf10f0-61df-4680-b849-1713314dffcc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.549019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3faf10f0-61df-4680-b849-1713314dffcc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.549019] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3faf10f0-61df-4680-b849-1713314dffcc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.723789] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0a461a8-ce41-468d-b9bb-19fef2690b98: rpc.has_security_group_logging(os_id): False [ 1001.744103] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.744103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.744103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.744103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.744103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.744437] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.744563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.744633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.744895] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.744895] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.744970] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 is going to be created. [ 1001.836437] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.836615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.836710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.836894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.837089] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.857260] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 in Status: IN_PROGRESS for 2s [ 1002.052318] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.052528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.056438] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3faf10f0-61df-4680-b849-1713314dffcc with status ACTIVE [ 1002.056438] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.056438] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.056438] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.056769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.056769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.056925] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.057079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.057152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.057435] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.057510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.057882] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.057976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.058027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.058674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.058674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.058674] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3faf10f0-61df-4680-b849-1713314dffcc is going to be updated. [ 1002.090721] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.090880] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.090950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.091206] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.092028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.092028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3faf10f0-61df-4680-b849-1713314dffcc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.407949] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 1003.408448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.408534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.408854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.409157] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.409352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.409461] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.409657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.409744] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.409844] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.779212] env[65359]: INFO networking_nsxv3.common.synchronization [req-e0acdc61-b6ff-47a7-9a44-5eec1dea4ca2 req-1523c262-815d-4c1b-8d21-042f39ca3876 tempest-DeleteServersTestJSON-2065668722 tempest-DeleteServersTestJSON-2065668722-project-member] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1003.779787] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1003.780209] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.780349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.780427] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.780630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.780806] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.780903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.780962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.781143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.781232] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.781324] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.875707] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 in Status: SUCCESS [ 1003.875942] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.913165] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.189732] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-125 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.190152] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.190152] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.190380] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.190643] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.190802] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.190913] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.191156] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.191320] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.191548] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.191657] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.191765] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.191889] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.191994] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.192155] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.192295] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.214376] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.215026] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.215026] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.215026] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.215256] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-73fbe458-50a4-4a34-adb1-aadbf72036ff taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.215368] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-73fbe458-50a4-4a34-adb1-aadbf72036ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.215496] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-73fbe458-50a4-4a34-adb1-aadbf72036ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.219159] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-73fbe458-50a4-4a34-adb1-aadbf72036ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.219393] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73fbe458-50a4-4a34-adb1-aadbf72036ff',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.283808] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.284133] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.284133] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.284301] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.284352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.284545] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.284646] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.284722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.284885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.284956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.285081] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 1004.318254] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.318254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.318254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.318456] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.318614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.330568] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 1004.419306] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.722077] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.722077] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.722077] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.722332] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.722471] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.722817] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 73fbe458-50a4-4a34-adb1-aadbf72036ff not found, creating... [ 1004.722953] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.723093] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.723306] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.723624] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.723778] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.724121] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.724293] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.724424] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.724636] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.724771] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.724912] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 73fbe458-50a4-4a34-adb1-aadbf72036ff is going to be created. [ 1004.747369] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.747593] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.747718] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.747991] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.748519] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.748740] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-73fbe458-50a4-4a34-adb1-aadbf72036ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.922380] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.922563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.922637] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.922854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.922944] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.923067] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 1004.959774] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.960033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.960126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.960416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.960620] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.970808] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 1005.472093] env[65359]: INFO networking_nsxv3.common.synchronization [req-e0acdc61-b6ff-47a7-9a44-5eec1dea4ca2 req-7a28177e-56a5-4590-abb0-20c11b6cf18b service nova] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_rules [ 1005.472374] env[65359]: INFO networking_nsxv3.common.synchronization [req-e0acdc61-b6ff-47a7-9a44-5eec1dea4ca2 req-7a28177e-56a5-4590-abb0-20c11b6cf18b service nova] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1005.472460] env[65359]: INFO networking_nsxv3.common.synchronization [req-e0acdc61-b6ff-47a7-9a44-5eec1dea4ca2 req-7a28177e-56a5-4590-abb0-20c11b6cf18b service nova] Enqueued Resource ID: 73fbe458-50a4-4a34-adb1-aadbf72036ff with Priority: HIGHEST for action port [ 1005.473730] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_rules [ 1005.473934] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1005.474060] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fbe458-50a4-4a34-adb1-aadbf72036ff with Priority: HIGHEST for action port [ 1005.474439] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.474574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.474642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.474849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.474932] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.475994] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.475994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.476217] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-73fbe458-50a4-4a34-adb1-aadbf72036ff taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.476323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73fbe458-50a4-4a34-adb1-aadbf72036ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.476397] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73fbe458-50a4-4a34-adb1-aadbf72036ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.476568] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73fbe458-50a4-4a34-adb1-aadbf72036ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.476684] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73fbe458-50a4-4a34-adb1-aadbf72036ff',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.978839] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.978978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.979086] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73fbe458-50a4-4a34-adb1-aadbf72036ff with status ACTIVE [ 1005.979712] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.979712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.979712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.979712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.980246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.980246] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.980246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.980246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.980501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.980501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.980692] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.980810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.980894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.981178] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.981293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.981395] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73fbe458-50a4-4a34-adb1-aadbf72036ff is going to be updated. [ 1006.002525] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.002674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.002818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.002952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.003099] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.003331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73fbe458-50a4-4a34-adb1-aadbf72036ff" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.343409] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 1006.343409] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb deletion is rescheduled due to dependency. [ 1006.343409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.343409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.343409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.343409] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.343409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.343409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.343409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.343409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.343409] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.846061] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.983463] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 1006.983657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.983806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.984018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.984221] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.984346] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.984407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.984574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.984660] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.984746] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.984836] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.349143] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.489638] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.490802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.490802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.490802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.491464] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.491628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.491713] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.491946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.492027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.492129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.494383] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.494383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.494383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.494383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.494383] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.494383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.494383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.494383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.494383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.494383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.494383] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.852077] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.852388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.852388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.852748] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.852748] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.852748] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 1007.887027] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.887027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.887027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.887027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.887027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.905411] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 1008.000924] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5: rpc.has_security_group_logging(os_id): False [ 1008.020789] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.020955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.021017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.021404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.021517] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.021766] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.021878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.021941] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.022132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.022215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.022417] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.022520] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.022607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.022715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.022788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.022965] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.023072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.023132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.023334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.023428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.023490] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 1008.098772] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.099351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.099351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.099503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.099914] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.117471] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 1008.585574] env[65359]: INFO networking_nsxv3.common.synchronization [req-9e046045-6ce3-4141-bbc9-7e33c5d65a83 req-1ca7e91d-96dd-487f-9bab-7aa680e00b6c tempest-AttachVolumeShelveTestJSON-543762586 tempest-AttachVolumeShelveTestJSON-543762586-project-member] Enqueued Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_members [ 1008.586228] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_members [ 1008.586401] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-db3579e6-ea77-4102-ba19-0829034e0bac taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.586519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.586583] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.586851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.587049] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.587166] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.587226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.587613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.587613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.587613] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.046825] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-124 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.047121] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.047158] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.047436] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.047701] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.047879] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.048086] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.048344] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.048522] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.048743] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.048879] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.048992] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.049113] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.049239] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.049351] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.049485] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.070351] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.070591] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1009.070812] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.071195] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.071615] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-f84a4b7b-910c-425c-a5c5-718a49fa99e7 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.071824] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.072073] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.072282] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.072425] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f84a4b7b-910c-425c-a5c5-718a49fa99e7',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.091390] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.091573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.091628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.092218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.092218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.092218] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.092699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.092699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.092699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.092699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.092845] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db3579e6-ea77-4102-ba19-0829034e0bac already deleted. [ 1009.092845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.164785] env[65359]: INFO networking_nsxv3.common.synchronization [req-ffee1210-f12b-43f1-a237-3b2816ec30cb req-918d2bc3-43f9-41f0-a2b3-ebda64df2099 tempest-ServerActionsV293TestJSON-1704396028 tempest-ServerActionsV293TestJSON-1704396028-project-member] Enqueued Resource ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e with Priority: HIGHEST for action security_group_members [ 1009.165774] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e with Priority: HIGHEST for action security_group_members [ 1009.166282] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.166478] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.166568] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.166799] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.167265] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.167265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.167265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.167472] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.167625] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.167776] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c69a6fc7-9355-4fca-ac8f-5d59227f6c2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.575029] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.575270] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.575394] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.575720] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.575880] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.576046] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port f84a4b7b-910c-425c-a5c5-718a49fa99e7 not found, creating... [ 1009.576314] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.576476] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.576593] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.576809] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.576942] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.577230] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.577385] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.577501] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.577701] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.577828] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.577964] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: f84a4b7b-910c-425c-a5c5-718a49fa99e7 is going to be created. [ 1009.598563] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.598767] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.598920] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.599202] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.599432] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.599652] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.671947] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.672194] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.672272] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.672496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.672595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.672810] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.672920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.672981] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.673147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.673223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.673336] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e is going to be updated. [ 1009.709799] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.709973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.710147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.710251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.710557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.722103] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e in Status: IN_PROGRESS for 2s [ 1009.918325] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 1009.918325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.918325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.918633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.919111] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.919111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.919111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.919324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.921702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.921702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.921702] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.135262] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 1010.135865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.298503] env[65359]: INFO networking_nsxv3.common.synchronization [req-858bb9a1-f201-4b8f-ba23-d174bb8c2883 req-4d948c8b-66e4-43f2-b7b8-4a8f125e09bb tempest-ImagesTestJSON-1497561183 tempest-ImagesTestJSON-1497561183-project-member] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 1010.298503] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGHEST for action security_group_members [ 1010.299374] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.299661] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.299894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.300199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.300449] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.300656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.300800] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.301049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.301223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.301449] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.381619] env[65359]: INFO networking_nsxv3.common.synchronization [req-9e046045-6ce3-4141-bbc9-7e33c5d65a83 req-7f834f3b-e642-422d-983b-9430089630f5 service nova] Enqueued Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_rules [ 1010.381619] env[65359]: INFO networking_nsxv3.common.synchronization [req-9e046045-6ce3-4141-bbc9-7e33c5d65a83 req-7f834f3b-e642-422d-983b-9430089630f5 service nova] Enqueued Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_members [ 1010.381619] env[65359]: INFO networking_nsxv3.common.synchronization [req-9e046045-6ce3-4141-bbc9-7e33c5d65a83 req-7f834f3b-e642-422d-983b-9430089630f5 service nova] Enqueued Resource ID: f84a4b7b-910c-425c-a5c5-718a49fa99e7 with Priority: HIGHEST for action port [ 1010.381619] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_rules [ 1010.381619] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_members [ 1010.383103] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f84a4b7b-910c-425c-a5c5-718a49fa99e7 with Priority: HIGHEST for action port [ 1010.383103] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db3579e6-ea77-4102-ba19-0829034e0bac taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.383103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.383103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.383103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.383103] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.383770] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-db3579e6-ea77-4102-ba19-0829034e0bac taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.383770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.383770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.384333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.384587] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.384746] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.384871] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.385146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.385292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.385470] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.386582] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-f84a4b7b-910c-425c-a5c5-718a49fa99e7 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.386707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.386753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.386930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.387161] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f84a4b7b-910c-425c-a5c5-718a49fa99e7',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.422012] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.422197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.422272] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.422659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.422703] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.422783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.422873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.423508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.423508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.423508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.423663] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.423663] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.423760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.423879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.424041] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.424179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.424267] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.424493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.424561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.425386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.425386] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.803561] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.803853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.803853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.804084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.804181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.804469] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.804577] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.804640] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.804817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.804927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.805029] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be updated. [ 1010.853655] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.853830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.853830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.854020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.854176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.863923] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: IN_PROGRESS for 2s [ 1010.888558] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-db3579e6-ea77-4102-ba19-0829034e0bac taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.888775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.890185] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.891331] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f84a4b7b-910c-425c-a5c5-718a49fa99e7 with status ACTIVE [ 1010.892565] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.892565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.892565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.892565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.892565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.892565] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.892565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.892565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.892896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.892896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.895982] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.896156] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.896230] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.897955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.897955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.897955] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f84a4b7b-910c-425c-a5c5-718a49fa99e7 is going to be updated. [ 1010.922626] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.922763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.922835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.923077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.923203] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.923392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.927934] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6b655ed-9de5-4842-96d3-3652c9e45ddb: rpc.has_security_group_logging(os_id): False [ 1010.951834] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.951834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.951834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.951834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.951834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.951834] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.951834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.951834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.951834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.951834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.951834] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.951834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.951834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.951834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.951834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.953375] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.953375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.953375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.953375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.953375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.953375] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 1011.048704] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.048927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.048994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.049804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.049804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.067539] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 1011.399606] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.734540] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e in Status: SUCCESS [ 1011.735337] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e deletion is rescheduled due to dependency. [ 1011.735337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.902994] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.902994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.902994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.903246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.903246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.903415] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db3579e6-ea77-4102-ba19-0829034e0bac is going to be created. [ 1011.931778] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.932044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.932044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.932352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.932461] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.945042] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db3579e6-ea77-4102-ba19-0829034e0bac in Status: UNINITIALIZED for 2s [ 1012.339408] env[65359]: INFO networking_nsxv3.common.synchronization [req-eb83ec42-ec45-4685-a511-92f22b2db028 req-9a1fde2e-c6d6-4dcf-8e0f-73eefe91be3d tempest-AttachVolumeTestJSON-1956829346 tempest-AttachVolumeTestJSON-1956829346-project-member] Enqueued Resource ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 with Priority: HIGHEST for action security_group_members [ 1012.339999] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 with Priority: HIGHEST for action security_group_members [ 1012.340434] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.340575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.340820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.341101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.341357] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.341484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.341550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.341721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.341813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.341909] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e88dc066-ae5f-45ff-a0ca-c16383ec5af9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.812907] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-730 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.813328] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-730" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.813597] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-730" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.813772] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-730" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.814094] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.814291] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.814453] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.814770] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.814868] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.815098] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.815208] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.815314] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.815421] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.815527] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.815652] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.815824] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.840390] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.840626] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1012.840719] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.840900] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-730" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.841305] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-ce4b6dcd-1786-43fe-bfa5-c0a46eecf889 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.841721] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-ce4b6dcd-1786-43fe-bfa5-c0a46eecf889" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.841862] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-ce4b6dcd-1786-43fe-bfa5-c0a46eecf889" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.842268] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-ce4b6dcd-1786-43fe-bfa5-c0a46eecf889" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.842453] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce4b6dcd-1786-43fe-bfa5-c0a46eecf889',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.844328] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.844485] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.844485] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.844657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.844779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.844941] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.845055] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.845118] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.845275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.845353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.845440] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 already deleted. [ 1012.845522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.874661] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28737c44-388f-4cb8-9cac-0181cbb28981 in Status: SUCCESS [ 1012.874842] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 deletion is rescheduled due to dependency. [ 1012.874956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.083567] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 1013.083567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.345537] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.345764] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.345968] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.346411] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.346882] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.347667] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port ce4b6dcd-1786-43fe-bfa5-c0a46eecf889 not found, creating... [ 1013.348822] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.348822] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.348822] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.348822] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.349155] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.350174] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.351053] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.351305] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.351600] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.351797] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.351996] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: ce4b6dcd-1786-43fe-bfa5-c0a46eecf889 is going to be created. [ 1013.380292] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.380292] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.380454] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.381573] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.381872] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.383809] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-ce4b6dcd-1786-43fe-bfa5-c0a46eecf889" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.561958] env[65359]: INFO networking_nsxv3.common.synchronization [req-d592a982-6fc2-41a8-9c42-776a06045b5c req-a1199891-0b76-4eac-acfe-bdc8edce8533 tempest-ServersTestJSON-1929866617 tempest-ServersTestJSON-1929866617-project-member] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1013.562259] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1013.563188] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.563453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.563593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.563841] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.564020] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.564128] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.564190] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.564369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.564455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.564567] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.959115] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db3579e6-ea77-4102-ba19-0829034e0bac in Status: SUCCESS [ 1013.959445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.959525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.959811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.959959] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.960087] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.960156] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.960312] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.960403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.960483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.960574] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.067724] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.088510] env[65359]: INFO networking_nsxv3.common.synchronization [req-eb83ec42-ec45-4685-a511-92f22b2db028 req-ca9b3699-3edf-4d5f-abe6-9fbd1d3bba3a service nova] Enqueued Resource ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 with Priority: HIGHEST for action security_group_rules [ 1014.088510] env[65359]: INFO networking_nsxv3.common.synchronization [req-eb83ec42-ec45-4685-a511-92f22b2db028 req-ca9b3699-3edf-4d5f-abe6-9fbd1d3bba3a service nova] Enqueued Resource ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 with Priority: HIGHEST for action security_group_members [ 1014.088674] env[65359]: INFO networking_nsxv3.common.synchronization [req-eb83ec42-ec45-4685-a511-92f22b2db028 req-ca9b3699-3edf-4d5f-abe6-9fbd1d3bba3a service nova] Enqueued Resource ID: ce4b6dcd-1786-43fe-bfa5-c0a46eecf889 with Priority: HIGHEST for action port [ 1014.091879] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 with Priority: HIGHEST for action security_group_rules [ 1014.091879] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 with Priority: HIGHEST for action security_group_members [ 1014.091879] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4b6dcd-1786-43fe-bfa5-c0a46eecf889 with Priority: HIGHEST for action port [ 1014.091879] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.091879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.091879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.091879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.091879] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e88dc066-ae5f-45ff-a0ca-c16383ec5af9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.093200] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.093447] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.093580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.093822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.094045] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.094161] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.094228] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.094451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.094545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.094643] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e88dc066-ae5f-45ff-a0ca-c16383ec5af9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.096306] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce4b6dcd-1786-43fe-bfa5-c0a46eecf889 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.096306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce4b6dcd-1786-43fe-bfa5-c0a46eecf889" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.096306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce4b6dcd-1786-43fe-bfa5-c0a46eecf889" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.096611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce4b6dcd-1786-43fe-bfa5-c0a46eecf889" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.096734] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce4b6dcd-1786-43fe-bfa5-c0a46eecf889',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.462923] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.510361] env[65359]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1014.511059] env[65359]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1014.570629] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.600862] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.601069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.601069] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e88dc066-ae5f-45ff-a0ca-c16383ec5af9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.602424] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce4b6dcd-1786-43fe-bfa5-c0a46eecf889 with status ACTIVE [ 1014.602424] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.602424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.602620] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.602795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.602858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.602989] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.603112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.603359] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.605131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.605227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.605933] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.605933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.606365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.606596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.606680] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.607088] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce4b6dcd-1786-43fe-bfa5-c0a46eecf889 is going to be updated. [ 1014.633420] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.633648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.633750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.633997] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.634180] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.634450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce4b6dcd-1786-43fe-bfa5-c0a46eecf889" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.965410] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db3579e6-ea77-4102-ba19-0829034e0bac: rpc.has_security_group_logging(os_id): False [ 1014.984781] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.985034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.985034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.985292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.985349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.985637] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.986141] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.986141] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.986407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.986407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.986595] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db3579e6-ea77-4102-ba19-0829034e0bac is going to be created. [ 1015.050172] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.050332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.050433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.050671] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.050855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.064616] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db3579e6-ea77-4102-ba19-0829034e0bac in Status: IN_PROGRESS for 2s [ 1015.076231] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.076432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.076485] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.076730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.076795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.077236] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 1015.110126] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e88dc066-ae5f-45ff-a0ca-c16383ec5af9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.128342] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.128479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.128574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.128753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.128958] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.154645] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 1015.613686] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.614557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.618153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.618153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.618153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.618153] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 is going to be created. [ 1015.642473] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.642602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.643366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.643641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.643813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.656267] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 in Status: UNINITIALIZED for 2s [ 1016.153839] env[65359]: INFO networking_nsxv3.common.synchronization [None req-8b2e0a28-06a0-4876-8b6f-3df784972686 None None] Enqueued Resource ID: a59b052f-00b8-48f4-afc1-1e702a56f4ba with Priority: HIGHEST for action port [ 1016.153839] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59b052f-00b8-48f4-afc1-1e702a56f4ba with Priority: HIGHEST for action port [ 1016.153839] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-a59b052f-00b8-48f4-afc1-1e702a56f4ba taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.153839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a59b052f-00b8-48f4-afc1-1e702a56f4ba" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.153839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a59b052f-00b8-48f4-afc1-1e702a56f4ba" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.154908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a59b052f-00b8-48f4-afc1-1e702a56f4ba" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.155171] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a59b052f-00b8-48f4-afc1-1e702a56f4ba',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.660394] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a59b052f-00b8-48f4-afc1-1e702a56f4ba [ 1016.660394] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.660394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.660394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.660394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.660394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.660394] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a59b052f-00b8-48f4-afc1-1e702a56f4ba already deleted. [ 1016.660394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a59b052f-00b8-48f4-afc1-1e702a56f4ba" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.091230] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db3579e6-ea77-4102-ba19-0829034e0bac in Status: SUCCESS [ 1017.091468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.170109] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 1017.170436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.669921] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 in Status: SUCCESS [ 1017.670620] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.670620] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.670620] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.670756] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.670853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.670918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.671088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.671164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.671274] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.671378] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e88dc066-ae5f-45ff-a0ca-c16383ec5af9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.176858] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e88dc066-ae5f-45ff-a0ca-c16383ec5af9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.608320] env[65359]: INFO networking_nsxv3.common.synchronization [None req-20511b41-2cf3-4614-b548-85264694bfb0 None None] Enqueued Resource ID: 11ae74e7-3b0f-43ec-bd1a-518e0d146cb0 with Priority: HIGHEST for action port [ 1018.608835] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ae74e7-3b0f-43ec-bd1a-518e0d146cb0 with Priority: HIGHEST for action port [ 1018.609290] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-11ae74e7-3b0f-43ec-bd1a-518e0d146cb0 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.609455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11ae74e7-3b0f-43ec-bd1a-518e0d146cb0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.609605] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11ae74e7-3b0f-43ec-bd1a-518e0d146cb0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.609894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11ae74e7-3b0f-43ec-bd1a-518e0d146cb0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.610026] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11ae74e7-3b0f-43ec-bd1a-518e0d146cb0',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.677096] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e88dc066-ae5f-45ff-a0ca-c16383ec5af9: rpc.has_security_group_logging(os_id): False [ 1018.697323] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.699357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.699357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.699357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.699357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.699357] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.699357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.699357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.699357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.699357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.701175] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 is going to be created. [ 1018.778475] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.778475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.778475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.778475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.778475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.792551] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 in Status: IN_PROGRESS for 2s [ 1018.871319] env[65359]: INFO networking_nsxv3.common.synchronization [None req-5b9ac7d0-3400-40cc-905b-088b93ed969a None None] Enqueued Resource ID: f1b0043e-b0a7-4a2a-9a25-f750e60d3bd2 with Priority: HIGHEST for action port [ 1018.871833] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1b0043e-b0a7-4a2a-9a25-f750e60d3bd2 with Priority: HIGHEST for action port [ 1018.872176] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1b0043e-b0a7-4a2a-9a25-f750e60d3bd2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.872299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1b0043e-b0a7-4a2a-9a25-f750e60d3bd2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.872404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1b0043e-b0a7-4a2a-9a25-f750e60d3bd2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.872610] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1b0043e-b0a7-4a2a-9a25-f750e60d3bd2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.872693] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1b0043e-b0a7-4a2a-9a25-f750e60d3bd2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.114500] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11ae74e7-3b0f-43ec-bd1a-518e0d146cb0 [ 1019.114500] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.114500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.114500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.114500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.114500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.114500] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11ae74e7-3b0f-43ec-bd1a-518e0d146cb0 already deleted. [ 1019.114500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11ae74e7-3b0f-43ec-bd1a-518e0d146cb0" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.135035] env[65359]: INFO networking_nsxv3.common.synchronization [req-9973a5b9-b9d2-4ae9-bd07-9b540b3bbf81 req-ac672773-1107-426f-a267-34ca85926eea tempest-ServersNegativeTestJSON-839733669 tempest-ServersNegativeTestJSON-839733669-project-member] Enqueued Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_members [ 1019.135687] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_members [ 1019.136286] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.136499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.136615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.136860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.137086] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.137240] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.137347] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.137622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.137764] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.137908] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.378401] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1b0043e-b0a7-4a2a-9a25-f750e60d3bd2 [ 1019.378401] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.378776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.378776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.378859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.378901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.378997] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1b0043e-b0a7-4a2a-9a25-f750e60d3bd2 already deleted. [ 1019.379081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1b0043e-b0a7-4a2a-9a25-f750e60d3bd2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.593595] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.593752] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-376" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.593882] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-376" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.594175] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-376" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.594460] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.594827] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.594827] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.594923] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.599335] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.599335] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1019.599335] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.599335] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.599512] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.599512] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1019.599590] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.599774] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.619979] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.619979] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1019.619979] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.619979] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-376" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.619979] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-cecb0640-75e1-476a-91ad-609dc99de90c taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.619979] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-cecb0640-75e1-476a-91ad-609dc99de90c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.622416] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-cecb0640-75e1-476a-91ad-609dc99de90c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.622416] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-cecb0640-75e1-476a-91ad-609dc99de90c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.622416] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cecb0640-75e1-476a-91ad-609dc99de90c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.640347] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.902458] env[65359]: INFO networking_nsxv3.common.synchronization [req-dde80d50-49fd-4e5e-baf5-1380a1b664e2 req-58afb36b-900f-457c-b963-ea0a328fcb5a tempest-DeleteServersTestJSON-2065668722 tempest-DeleteServersTestJSON-2065668722-project-member] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1019.903192] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1019.903715] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.903928] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.904057] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.904396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.904587] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.904750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.904858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.905108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.905259] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.905411] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.124834] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.125092] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.125189] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.125476] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.125630] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.125811] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port cecb0640-75e1-476a-91ad-609dc99de90c not found, creating... [ 1020.126100] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.126271] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.126382] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.126601] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.126739] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.127027] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.127186] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.127300] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.127506] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.127639] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.127774] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: cecb0640-75e1-476a-91ad-609dc99de90c is going to be created. [ 1020.144550] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.150685] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.150941] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.151086] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.151487] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.151722] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.151946] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-cecb0640-75e1-476a-91ad-609dc99de90c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.410284] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.410284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.410284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.410284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.410284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.410284] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.410284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.410284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.410284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.410284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.410284] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 1020.438575] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.438725] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.438795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.439012] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.439173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.448154] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 1020.648859] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.648859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.648859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.648859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.648859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.650406] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31844aa-4ad6-4249-8902-93e89324b0b5 is going to be updated. [ 1020.682756] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.682979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.682979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.683136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.683408] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.693178] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: IN_PROGRESS for 2s [ 1020.807757] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 in Status: SUCCESS [ 1020.808360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.927672] env[65359]: INFO networking_nsxv3.common.synchronization [req-9973a5b9-b9d2-4ae9-bd07-9b540b3bbf81 req-508caab7-2170-4546-a3ab-4ce128faa8c1 service nova] Enqueued Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_rules [ 1020.927877] env[65359]: INFO networking_nsxv3.common.synchronization [req-9973a5b9-b9d2-4ae9-bd07-9b540b3bbf81 req-508caab7-2170-4546-a3ab-4ce128faa8c1 service nova] Enqueued Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_members [ 1020.927989] env[65359]: INFO networking_nsxv3.common.synchronization [req-9973a5b9-b9d2-4ae9-bd07-9b540b3bbf81 req-508caab7-2170-4546-a3ab-4ce128faa8c1 service nova] Enqueued Resource ID: cecb0640-75e1-476a-91ad-609dc99de90c with Priority: HIGHEST for action port [ 1020.928484] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_rules [ 1020.928641] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_members [ 1020.928708] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cecb0640-75e1-476a-91ad-609dc99de90c with Priority: HIGHEST for action port [ 1020.928946] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.930134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.930989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.930989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.930989] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.931527] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.931658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.932124] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-cecb0640-75e1-476a-91ad-609dc99de90c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.932124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cecb0640-75e1-476a-91ad-609dc99de90c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.932124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cecb0640-75e1-476a-91ad-609dc99de90c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.932340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cecb0640-75e1-476a-91ad-609dc99de90c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.932387] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cecb0640-75e1-476a-91ad-609dc99de90c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.100235] env[65359]: INFO networking_nsxv3.common.synchronization [req-ee617490-9fc5-45c5-8741-bb731392757e req-e70c7782-1cf7-40d9-8ef4-7ee05d1aa76a tempest-ServerActionsTestJSON-975876043 tempest-ServerActionsTestJSON-975876043-project-member] Enqueued Resource ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d with Priority: HIGHEST for action security_group_members [ 1021.101653] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d with Priority: HIGHEST for action security_group_members [ 1021.102223] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.102416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.102522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.102803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.103043] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.103200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.103300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.103585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.105656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.106963] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.433831] env[65359]: INFO networking_nsxv3.common.synchronization [None req-68353277-9871-426c-8f7e-2c67725260ce None None] Enqueued Resource ID: 4d6aac35-d73c-4f2c-a8e0-55d357a5287c with Priority: HIGHEST for action port [ 1021.434994] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.435133] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.435270] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6aac35-d73c-4f2c-a8e0-55d357a5287c with Priority: HIGHEST for action port [ 1021.437069] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cecb0640-75e1-476a-91ad-609dc99de90c with status ACTIVE [ 1021.437069] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.437069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.437069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.437069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.437069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.437069] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.437069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.437069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.437069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.437069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.437069] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.437069] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.437970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.437970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.437970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.437970] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cecb0640-75e1-476a-91ad-609dc99de90c is going to be updated. [ 1021.439451] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d6aac35-d73c-4f2c-a8e0-55d357a5287c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.439451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d6aac35-d73c-4f2c-a8e0-55d357a5287c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.439451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d6aac35-d73c-4f2c-a8e0-55d357a5287c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.439451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d6aac35-d73c-4f2c-a8e0-55d357a5287c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.439713] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d6aac35-d73c-4f2c-a8e0-55d357a5287c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.461887] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.462120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.462269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.462453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.462828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.462914] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cecb0640-75e1-476a-91ad-609dc99de90c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.611470] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.612068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.612068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.612068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.640635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.640635] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.640635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.640635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.640635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.640635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.640635] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d is going to be updated. [ 1021.667253] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.667476] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.667580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.668783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.668783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.686523] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d in Status: IN_PROGRESS for 2s [ 1021.943048] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d6aac35-d73c-4f2c-a8e0-55d357a5287c [ 1021.943376] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.943760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.943760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.943942] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.943942] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.944109] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d6aac35-d73c-4f2c-a8e0-55d357a5287c already deleted. [ 1021.944109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d6aac35-d73c-4f2c-a8e0-55d357a5287c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.459412] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 1022.460215] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb deletion is rescheduled due to dependency. [ 1022.460215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.706406] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: SUCCESS [ 1022.706607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.706771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.706985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.707183] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.707303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.707367] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.707535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.707641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.707767] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.210421] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.705528] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d in Status: SUCCESS [ 1023.705824] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d deletion is rescheduled due to dependency. [ 1023.705974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.715413] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.218101] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.218320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.218395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.218555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.218645] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.218745] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31844aa-4ad6-4249-8902-93e89324b0b5 is going to be updated. [ 1024.251481] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.251481] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.251481] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.252057] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.252091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.262199] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: IN_PROGRESS for 2s [ 1026.273163] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: SUCCESS [ 1026.273560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.273664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.273803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.273996] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.274132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.274201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.274352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.274439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.274528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.274618] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.436772] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1026.436918] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1026.776786] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.776969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.777025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.777253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.777420] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.777527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.777592] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.777752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.777827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.777912] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.778162] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.778162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.778283] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.778349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.778496] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.778590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.778649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.778789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.779085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.779085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.779085] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.282012] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a31844aa-4ad6-4249-8902-93e89324b0b5: rpc.has_security_group_logging(os_id): False [ 1027.306800] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.307047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.307139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.307299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.307409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.307641] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.307750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.307895] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.308690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.308690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.308690] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.308690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.308690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.308690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.308986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.309334] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.309334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.309334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.309501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.309546] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.309616] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a31844aa-4ad6-4249-8902-93e89324b0b5 is going to be updated. [ 1027.422648] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.422824] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.422871] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.423137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.423495] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.449569] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: IN_PROGRESS for 2s [ 1027.557912] env[65359]: INFO networking_nsxv3.common.synchronization [req-451ddeef-1a5f-40f4-be69-31883088ada5 req-af69436d-3aae-4490-9f37-dcb49b51d1c7 tempest-ServerAddressesNegativeTestJSON-722493046 tempest-ServerAddressesNegativeTestJSON-722493046-project-member] Enqueued Resource ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a with Priority: HIGHEST for action security_group_members [ 1027.558100] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a with Priority: HIGHEST for action security_group_members [ 1027.558302] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.558430] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.558498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.558758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.558914] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.559254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.559254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.559254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.559398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.559435] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbe5a022-ed60-49c4-95a8-0a8fb4015b9a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.906037] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.906209] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-842" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.906209] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-842" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.906513] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-842" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.906769] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.906925] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.907053] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.907274] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.907420] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.907631] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.907741] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.907849] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.907959] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.908082] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.908188] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.908320] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.926912] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.927084] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1027.927174] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.927351] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-842" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.927660] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.927825] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.927946] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.928286] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.928423] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.062018] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.062213] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.062281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.062499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.062583] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.062776] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.062871] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.062929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.063087] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.063165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.063249] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a already deleted. [ 1028.063328] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.431296] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.431296] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.431802] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.431802] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.431802] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.431956] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62 not found, creating... [ 1028.432235] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.432393] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.432509] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.432723] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.432858] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.433148] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.433353] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.433518] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.434137] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.434137] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.434137] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62 is going to be created. [ 1028.455427] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.455717] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.455869] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.456171] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.456397] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.456637] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.209756] env[65359]: INFO networking_nsxv3.common.synchronization [req-451ddeef-1a5f-40f4-be69-31883088ada5 req-46dd78ee-7100-4272-98bb-feae8c45a72e service nova] Enqueued Resource ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a with Priority: HIGHEST for action security_group_rules [ 1029.209756] env[65359]: INFO networking_nsxv3.common.synchronization [req-451ddeef-1a5f-40f4-be69-31883088ada5 req-46dd78ee-7100-4272-98bb-feae8c45a72e service nova] Enqueued Resource ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a with Priority: HIGHEST for action security_group_members [ 1029.209959] env[65359]: INFO networking_nsxv3.common.synchronization [req-451ddeef-1a5f-40f4-be69-31883088ada5 req-46dd78ee-7100-4272-98bb-feae8c45a72e service nova] Enqueued Resource ID: 9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62 with Priority: HIGHEST for action port [ 1029.210448] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a with Priority: HIGHEST for action security_group_rules [ 1029.210581] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a with Priority: HIGHEST for action security_group_members [ 1029.210677] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62 with Priority: HIGHEST for action port [ 1029.210951] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.215161] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.215248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.215523] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.215659] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbe5a022-ed60-49c4-95a8-0a8fb4015b9a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.216573] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.218210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.218210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.218210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.218210] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.218210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.218210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.218210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.218210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.218210] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbe5a022-ed60-49c4-95a8-0a8fb4015b9a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.220037] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.220375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.220375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.220375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.220551] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.465330] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: SUCCESS [ 1029.465619] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.723364] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbe5a022-ed60-49c4-95a8-0a8fb4015b9a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.724629] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.724785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.725015] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62 with status ACTIVE [ 1029.725219] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.725315] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.725396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.725615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.725705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.726018] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.726018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.726125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.726233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.726298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.727255] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.727378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.727507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.727700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.727794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.727886] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62 is going to be updated. [ 1029.761579] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.761679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.761772] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.761976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.762139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.762302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ee5c8dc-e9eb-4e86-9a8b-ca36dd37df62" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.230290] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbe5a022-ed60-49c4-95a8-0a8fb4015b9a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.732607] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.733160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.733160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.733290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.733463] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.733583] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a is going to be created. [ 1030.767840] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.767840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.767840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.768087] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.768194] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.784999] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a in Status: UNINITIALIZED for 2s [ 1031.120522] env[65359]: INFO networking_nsxv3.common.synchronization [req-308b70c8-82b3-46bb-a728-4014f6b2da82 req-61525b64-250a-4875-ab1e-4cc98de526e7 tempest-ServersNegativeTestJSON-839733669 tempest-ServersNegativeTestJSON-839733669-project-member] Enqueued Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_members [ 1031.122022] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_members [ 1031.122022] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.122022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.122022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.122022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.122022] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.122385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.122385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.122461] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.122549] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.122649] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.626822] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.131480] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.635340] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.635340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.635340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.635530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.635530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.635613] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31844aa-4ad6-4249-8902-93e89324b0b5 is going to be updated. [ 1032.640073] env[65359]: INFO networking_nsxv3.common.synchronization [None req-15a380f0-5ba1-41c3-9380-37e2ae5ad083 tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_rules [ 1032.640814] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_rules [ 1032.641345] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.641492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.641596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.641981] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.642062] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.670808] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.671016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.671016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.671263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.671374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.680716] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: IN_PROGRESS for 2s [ 1032.744667] env[65359]: INFO networking_nsxv3.common.synchronization [None req-3642abfc-97b3-46fd-8ccf-76fa2416df38 tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_rules [ 1032.745484] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_rules [ 1032.745845] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.745952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.795265] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a in Status: SUCCESS [ 1032.795463] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.795629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.796152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.796356] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.796477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.796542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.796699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.796780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.796903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.796952] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbe5a022-ed60-49c4-95a8-0a8fb4015b9a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.164658] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.164979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.164979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.165120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.165207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.165303] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 already deleted. [ 1033.165385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.165601] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.165921] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.166087] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.299554] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.299554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.300307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.300307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.300307] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.300307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.300307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.300307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.300548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.300548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.300728] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.300728] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.300827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.301236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.301236] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.301236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.301403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.302027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.302027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.302027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.302202] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbe5a022-ed60-49c4-95a8-0a8fb4015b9a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.689048] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.689246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.689294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.689503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.689595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.689691] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 already deleted. [ 1033.689858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.803999] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbe5a022-ed60-49c4-95a8-0a8fb4015b9a: rpc.has_security_group_logging(os_id): False [ 1033.823235] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.823494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.823494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.823971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.823971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.824106] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.824194] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.824290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.824462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.824752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.824849] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.824936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.825026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.825150] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.825256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.825500] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.825596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.825654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.825813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.825897] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.825962] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a is going to be created. [ 1033.888543] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.888862] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.888989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.889295] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.889527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.903654] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a in Status: IN_PROGRESS for 2s [ 1034.691907] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: SUCCESS [ 1034.692305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.915840] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a in Status: SUCCESS [ 1035.916253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.746675] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1037.746955] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1039.876102] env[65359]: INFO networking_nsxv3.common.synchronization [req-a2208063-ae17-4c82-b00d-8c849fa2fd3b req-da5e78ba-72f1-4720-b56f-b24dfa02a94a tempest-ServerAddressesNegativeTestJSON-722493046 tempest-ServerAddressesNegativeTestJSON-722493046-project-member] Enqueued Resource ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a with Priority: HIGHEST for action security_group_members [ 1039.876102] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a with Priority: HIGHEST for action security_group_members [ 1039.876102] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.876102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.876102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.876886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.876886] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.876886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.876886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.876886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.876886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.877100] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbe5a022-ed60-49c4-95a8-0a8fb4015b9a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.380032] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.380197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.380280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.380507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.380606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.380818] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.380911] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.380981] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.381176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.381327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.381419] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a is going to be updated. [ 1040.413051] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.413051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.413051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.413385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.413385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.426050] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a in Status: IN_PROGRESS for 2s [ 1042.439362] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a in Status: SUCCESS [ 1042.439691] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a deletion is rescheduled due to dependency. [ 1042.439691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.875430] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1044.875430] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1049.817455] env[65359]: INFO networking_nsxv3.common.synchronization [req-79cfea20-f508-433a-ac24-d6b64bd1f80e req-84995720-72f2-4308-9767-17a43eb96b4c tempest-ServerRescueNegativeTestJSON-174363340 tempest-ServerRescueNegativeTestJSON-174363340-project-member] Enqueued Resource ID: c5b458df-8f8e-47b7-9e32-899c590c5940 with Priority: HIGHEST for action security_group_members [ 1049.817455] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b458df-8f8e-47b7-9e32-899c590c5940 with Priority: HIGHEST for action security_group_members [ 1049.817455] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5b458df-8f8e-47b7-9e32-899c590c5940 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.817455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.817455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.817455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.817455] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.817916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.817916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.817916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.818026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.818097] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5b458df-8f8e-47b7-9e32-899c590c5940',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.322190] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.322820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.322820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.322820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.352212] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.352457] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.352592] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.352661] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.352839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.352926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.353057] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5b458df-8f8e-47b7-9e32-899c590c5940 is going to be updated. [ 1050.381027] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.381252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.381302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.381486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.381628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.391681] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b458df-8f8e-47b7-9e32-899c590c5940 in Status: IN_PROGRESS for 2s [ 1050.656142] env[65359]: INFO networking_nsxv3.common.synchronization [req-035c00bc-08c4-49f2-b203-5c195418294e req-e55d68b7-d7aa-49ca-86ef-0da35d16e806 tempest-ServersTestJSON-1929866617 tempest-ServersTestJSON-1929866617-project-member] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1050.657097] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1050.657900] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.657900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.657900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.657900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.657900] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.657900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.658280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.658280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.658280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.658280] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.160349] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.663451] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.165969] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.166310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.166310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.166440] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.166528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.166626] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 1052.195921] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.196106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.196106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.196320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.196461] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.205095] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 1052.403946] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5b458df-8f8e-47b7-9e32-899c590c5940 in Status: SUCCESS [ 1052.404198] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5b458df-8f8e-47b7-9e32-899c590c5940 deletion is rescheduled due to dependency. [ 1052.404337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.960042] env[65359]: INFO networking_nsxv3.common.synchronization [req-095dc8dd-97c8-4cd5-9086-ff3e3188c490 req-d397f507-df78-4019-a7e2-049d365daaf7 tempest-ServerRescueTestJSON-579547403 tempest-ServerRescueTestJSON-579547403-project-member] Enqueued Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_members [ 1052.960042] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_members [ 1052.960184] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.960261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.960334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.960590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.960749] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.960850] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.960913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.961074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.961161] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.961255] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.279928] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-649 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.280322] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-649" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.280567] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-649" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.281091] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-649" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.281545] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.281873] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.282142] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.282512] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.282697] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.282951] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.283094] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.283224] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.283338] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.283463] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.283573] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.283775] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.306468] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.306656] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1053.306894] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.307094] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-649" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.307456] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-68395452-3680-491b-86cf-eb3af6bb798f taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.307678] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-68395452-3680-491b-86cf-eb3af6bb798f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.307880] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-68395452-3680-491b-86cf-eb3af6bb798f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.308246] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-68395452-3680-491b-86cf-eb3af6bb798f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.308390] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68395452-3680-491b-86cf-eb3af6bb798f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.463504] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.463746] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.463874] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.464183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.464332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.464610] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.464783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.464892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.465128] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.465259] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.465403] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07f94052-66b8-4ea9-9b43-7b740cc698df already deleted. [ 1053.465543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.814288] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.814288] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.814288] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.814288] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.814288] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.814288] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 68395452-3680-491b-86cf-eb3af6bb798f not found, creating... [ 1053.814288] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.814288] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.814288] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.814288] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.814288] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.814755] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.814755] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.814976] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.815327] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.815577] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.815826] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 68395452-3680-491b-86cf-eb3af6bb798f is going to be created. [ 1053.837492] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.837492] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.837492] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.837492] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.837768] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.837851] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-68395452-3680-491b-86cf-eb3af6bb798f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.950653] env[65359]: INFO networking_nsxv3.common.synchronization [req-215e06fb-d6a4-4903-8c4d-772caa1025d7 req-24603db2-af05-44b5-a2df-8e982ef7d1c1 tempest-ServerDiskConfigTestJSON-2085995032 tempest-ServerDiskConfigTestJSON-2085995032-project-member] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 1053.950705] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 1053.950998] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.951142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.951206] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.951408] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.951695] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.951805] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.951867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.952024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.952112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.952209] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.214209] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 1054.214441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.459661] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.460018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.460018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.460307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.460430] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.460707] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.460839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.460950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.461268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.461382] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.461549] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be updated. [ 1054.490666] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.490850] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.490925] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.491146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.491416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.501190] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: IN_PROGRESS for 2s [ 1054.577738] env[65359]: INFO networking_nsxv3.common.synchronization [req-095dc8dd-97c8-4cd5-9086-ff3e3188c490 req-b9fedabe-94e8-467d-8675-fb2ef423f119 service nova] Enqueued Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_rules [ 1054.578284] env[65359]: INFO networking_nsxv3.common.synchronization [req-095dc8dd-97c8-4cd5-9086-ff3e3188c490 req-b9fedabe-94e8-467d-8675-fb2ef423f119 service nova] Enqueued Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_members [ 1054.578565] env[65359]: INFO networking_nsxv3.common.synchronization [req-095dc8dd-97c8-4cd5-9086-ff3e3188c490 req-b9fedabe-94e8-467d-8675-fb2ef423f119 service nova] Enqueued Resource ID: 68395452-3680-491b-86cf-eb3af6bb798f with Priority: HIGHEST for action port [ 1054.579447] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_rules [ 1054.579681] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_members [ 1054.581434] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68395452-3680-491b-86cf-eb3af6bb798f with Priority: HIGHEST for action port [ 1054.581434] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.581434] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.581814] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.581814] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.581892] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.582730] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.582840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.583144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.583144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.583276] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.583331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.583386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.583527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.583669] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.583850] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.584653] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-68395452-3680-491b-86cf-eb3af6bb798f taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.584767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68395452-3680-491b-86cf-eb3af6bb798f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.584825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68395452-3680-491b-86cf-eb3af6bb798f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.586423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68395452-3680-491b-86cf-eb3af6bb798f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.586423] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68395452-3680-491b-86cf-eb3af6bb798f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.586826] env[65359]: INFO networking_nsxv3.common.synchronization [None req-66c9b185-66b6-4a65-b575-23cc758bc678 tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: 13736951-03c6-4d53-ad2b-da3bf377face with Priority: HIGHEST for action security_group_rules [ 1054.587774] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13736951-03c6-4d53-ad2b-da3bf377face with Priority: HIGHEST for action security_group_rules [ 1054.588070] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13736951-03c6-4d53-ad2b-da3bf377face taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.588431] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.588431] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.588520] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.588520] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13736951-03c6-4d53-ad2b-da3bf377face',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.669195] env[65359]: INFO networking_nsxv3.common.synchronization [None req-bd979c65-15d1-49a2-bf80-d1189cba1468 tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: 13736951-03c6-4d53-ad2b-da3bf377face with Priority: HIGHEST for action security_group_rules [ 1054.669957] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13736951-03c6-4d53-ad2b-da3bf377face with Priority: HIGHEST for action security_group_rules [ 1054.670304] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13736951-03c6-4d53-ad2b-da3bf377face taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.670407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.088506] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68395452-3680-491b-86cf-eb3af6bb798f with status ACTIVE [ 1055.088506] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.088689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.088689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.088863] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.088959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.089613] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.089613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.089613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.089613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.089613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.089918] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.089918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.089918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.090121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.090121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.090121] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68395452-3680-491b-86cf-eb3af6bb798f is going to be updated. [ 1055.091385] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.092462] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.092462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.123790] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.123790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.123790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.123790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.123790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.123790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68395452-3680-491b-86cf-eb3af6bb798f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.124422] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.124541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.124628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.124904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.125019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.125113] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13736951-03c6-4d53-ad2b-da3bf377face already deleted. [ 1055.125670] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.125833] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.126040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.126135] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13736951-03c6-4d53-ad2b-da3bf377face',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.594867] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.650157] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.650319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.650405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.650635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.650748] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.650851] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13736951-03c6-4d53-ad2b-da3bf377face already deleted. [ 1055.650936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.097368] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.097368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.097368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.097599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.097650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.097777] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07f94052-66b8-4ea9-9b43-7b740cc698df is going to be created. [ 1056.124632] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.126400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.126400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.126400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.126400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.135773] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07f94052-66b8-4ea9-9b43-7b740cc698df in Status: UNINITIALIZED for 2s [ 1056.511610] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 1056.511811] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b deletion is rescheduled due to dependency. [ 1056.511811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.338300] env[65359]: INFO networking_nsxv3.common.synchronization [req-f4ac9258-2cda-4bb8-a3b0-0906b5941007 req-72bcf9d2-548c-4e53-99a5-081411899a34 tempest-ImagesOneServerTestJSON-1241293410 tempest-ImagesOneServerTestJSON-1241293410-project-member] Enqueued Resource ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 with Priority: HIGHEST for action security_group_members [ 1057.338938] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 with Priority: HIGHEST for action security_group_members [ 1057.339380] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.339640] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.339873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.340210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.340491] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.340742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.340907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.342341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.342341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.342341] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bf93232-d104-4fc5-a8d6-ea22dbf41b58',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.740476] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-518 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.740673] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-518" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.740812] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-518" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.741165] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-518" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.741831] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.742137] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.742276] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.742694] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.742861] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.743093] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.743210] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.743374] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.743492] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.743793] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.743999] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.744162] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.762347] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.762513] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.762641] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.762854] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-518" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.763180] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-670c16f3-6d44-4764-b2c3-d38a59a54475 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.763347] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-670c16f3-6d44-4764-b2c3-d38a59a54475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.763467] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-670c16f3-6d44-4764-b2c3-d38a59a54475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.763845] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-670c16f3-6d44-4764-b2c3-d38a59a54475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.763980] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('670c16f3-6d44-4764-b2c3-d38a59a54475',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.844672] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.844672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.844672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.844672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.844672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.844672] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.844672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.844672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.845164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.845164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.845164] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 already deleted. [ 1057.845164] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.144599] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07f94052-66b8-4ea9-9b43-7b740cc698df in Status: SUCCESS [ 1058.144816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.144961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.145201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.145399] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.145521] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.145585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.145742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.145819] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.145905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.145997] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.266594] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.266594] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.266820] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.267211] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.267411] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.267605] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 670c16f3-6d44-4764-b2c3-d38a59a54475 not found, creating... [ 1058.267928] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.268156] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.268305] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.268566] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.268736] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.269068] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.269270] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.269471] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.269630] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.269763] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.270036] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 670c16f3-6d44-4764-b2c3-d38a59a54475 is going to be created. [ 1058.292089] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.292307] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.292432] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.292706] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.292933] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.293178] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-670c16f3-6d44-4764-b2c3-d38a59a54475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.648554] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.648857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.648857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.649047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.649224] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.649341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.649398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.649550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.649644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.649736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.649885] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.649988] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.650075] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.650260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.650416] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.650515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.650592] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.650708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.650781] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.650858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.650951] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.032527] env[65359]: INFO networking_nsxv3.common.synchronization [req-f4ac9258-2cda-4bb8-a3b0-0906b5941007 req-17c3f467-ebaf-41fc-b685-dd7b7120bc41 service nova] Enqueued Resource ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 with Priority: HIGHEST for action security_group_rules [ 1059.032715] env[65359]: INFO networking_nsxv3.common.synchronization [req-f4ac9258-2cda-4bb8-a3b0-0906b5941007 req-17c3f467-ebaf-41fc-b685-dd7b7120bc41 service nova] Enqueued Resource ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 with Priority: HIGHEST for action security_group_members [ 1059.032850] env[65359]: INFO networking_nsxv3.common.synchronization [req-f4ac9258-2cda-4bb8-a3b0-0906b5941007 req-17c3f467-ebaf-41fc-b685-dd7b7120bc41 service nova] Enqueued Resource ID: 670c16f3-6d44-4764-b2c3-d38a59a54475 with Priority: HIGHEST for action port [ 1059.033386] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 with Priority: HIGHEST for action security_group_rules [ 1059.033525] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 with Priority: HIGHEST for action security_group_members [ 1059.033655] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670c16f3-6d44-4764-b2c3-d38a59a54475 with Priority: HIGHEST for action port [ 1059.034489] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bf93232-d104-4fc5-a8d6-ea22dbf41b58 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.034489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.034489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.034489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.034489] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bf93232-d104-4fc5-a8d6-ea22dbf41b58',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.035643] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.035775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.035843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.036035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.036186] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.036282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.036338] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.036479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.036560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.036642] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bf93232-d104-4fc5-a8d6-ea22dbf41b58',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.037382] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-670c16f3-6d44-4764-b2c3-d38a59a54475 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.037491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-670c16f3-6d44-4764-b2c3-d38a59a54475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.037632] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-670c16f3-6d44-4764-b2c3-d38a59a54475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.037683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-670c16f3-6d44-4764-b2c3-d38a59a54475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.037748] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('670c16f3-6d44-4764-b2c3-d38a59a54475',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.153429] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07f94052-66b8-4ea9-9b43-7b740cc698df: rpc.has_security_group_logging(os_id): False [ 1059.175681] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.175922] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.175922] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.176186] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.176284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.176485] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.176587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.176755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.176940] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.177031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.177245] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.177345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.177405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.177547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.177621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.177835] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.177933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.177987] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.178142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.178215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.178301] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07f94052-66b8-4ea9-9b43-7b740cc698df is going to be created. [ 1059.243251] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.243832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.243832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.243949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.244481] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.257106] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07f94052-66b8-4ea9-9b43-7b740cc698df in Status: IN_PROGRESS for 2s [ 1059.539538] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.539724] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.539947] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bf93232-d104-4fc5-a8d6-ea22dbf41b58',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.540839] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 670c16f3-6d44-4764-b2c3-d38a59a54475 with status ACTIVE [ 1059.541455] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.541567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.541711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.541900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.543066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.543066] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.543868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.543868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.543868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.543868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.543868] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.543868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.543868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.543868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.545223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.545223] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 670c16f3-6d44-4764-b2c3-d38a59a54475 is going to be updated. [ 1059.564533] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.564752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.564752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.564960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.565106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.565262] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-670c16f3-6d44-4764-b2c3-d38a59a54475" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.045874] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bf93232-d104-4fc5-a8d6-ea22dbf41b58',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.549106] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.549296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.549349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.549568] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.549656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.549755] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 is going to be created. [ 1060.579099] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.579302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.579302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.579641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.579840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.591804] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 in Status: UNINITIALIZED for 2s [ 1061.269769] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07f94052-66b8-4ea9-9b43-7b740cc698df in Status: SUCCESS [ 1061.270268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.471078] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.471469] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.471543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.471891] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.472060] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.610044] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 in Status: SUCCESS [ 1062.610044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.610044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.610044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.610044] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.610044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.610044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.610044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.610044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.610044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.610044] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bf93232-d104-4fc5-a8d6-ea22dbf41b58',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.974444] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.112766] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.112960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.113145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.113352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.113521] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.113636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.113760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.113933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.114038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.114127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.114277] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.114371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.114437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.114606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.114772] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.114869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.114946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.115105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.115181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.115264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.115353] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bf93232-d104-4fc5-a8d6-ea22dbf41b58',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.476994] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.617029] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bf93232-d104-4fc5-a8d6-ea22dbf41b58: rpc.has_security_group_logging(os_id): False [ 1063.637987] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.638166] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.638239] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.638596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.638695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.638900] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.639013] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.639113] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.639295] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.639398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.639610] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.639709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.639790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.639938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.640027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.640212] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.640309] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.640370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.640513] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.640586] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.640671] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 is going to be created. [ 1063.707701] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.707876] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.707989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.708253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.708433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.724377] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 in Status: IN_PROGRESS for 2s [ 1063.980056] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1063.980248] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1064.034535] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1064.034678] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1064.805511] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.805909] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.805909] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.806075] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.818294] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1064.819917] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.820834] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1064.857599] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.857765] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.857845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.858068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.871509] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.872288] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1064.872381] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.872475] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1064.919181] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.919363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.919456] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.919700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.921284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.921534] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1065.001029] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.001029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.001029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.001029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.001029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.001029] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1065.097667] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.097667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.097667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.098077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.098310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.098811] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1065.099009] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'09044820-85da-426b-b103-26678a0652e6', 'daa8b334-470d-4702-9560-94a964a51d78', '1b7c1c93-5692-4546-9b54-4011872a824d', 'ac4b252c-75eb-46d7-adb1-3c832626f301', '721fd3df-fecb-47e7-86f0-25de8502794c', 'f33a6cb0-88e0-45c4-8990-6da48fb9f1f5', 'fbe5a022-ed60-49c4-95a8-0a8fb4015b9a', 'ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d', 'c4dca704-f8c2-494f-bbf6-802020c49b4b', '99327ed1-6c09-451a-b316-eb0268988db2', '2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3', '3711d124-9bf8-4fa4-9c53-ee6c21e9b344', 'a0a461a8-ce41-468d-b9bb-19fef2690b98', '6eb7ac19-945a-427f-84cb-cc4a488527fc', 'c5b458df-8f8e-47b7-9e32-899c590c5940', 'd3577cfc-adec-4c56-bc24-6acdb8887663', '655ee501-2055-483e-a130-4cf497421bd3', '153868d0-4b9a-4493-8289-08b4b26dc07b', 'd6b655ed-9de5-4842-96d3-3652c9e45ddb', '3a269c68-1fd7-4085-a1d3-54f407762a6d', 'c69a6fc7-9355-4fca-ac8f-5d59227f6c2e', '07f94052-66b8-4ea9-9b43-7b740cc698df', 'c4a73e88-8afb-4866-a66b-2583f493db5e', '28737c44-388f-4cb8-9cac-0181cbb28981', '505f1bca-748c-4f56-9f01-2a595d335a84', '1bf93232-d104-4fc5-a8d6-ea22dbf41b58', '9eb6909a-01a5-44eb-b7ac-9d4770a02fb6', 'f713e30a-d102-48fb-9e09-3c3ec7abbc99', 'e88dc066-ae5f-45ff-a0ca-c16383ec5af9', '8c01e6ff-b831-4d21-8c9a-e3a067190d76', 'b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685', '93f7f41b-56ed-4593-aafe-31057cf7c6f5', 'e87bd638-a489-4449-9e26-acf0926c56dc', '1bbf694f-ad41-4969-a7b8-1248ccdf3fa1', 'b1f01646-6e50-4a59-a98b-3f8bba190b64', '1d7b1c61-3e92-4ac1-82a4-572363e1e5a5', '316dc9d7-17d3-414d-ba0c-8e1fd143cf19', 'a31844aa-4ad6-4249-8902-93e89324b0b5', 'c053aa73-c45e-4ff7-9c78-5faef3e76294', '8f94b344-4b21-4fd0-9c3a-2488e3e7e504', '582cfc14-9eeb-4704-a95a-052a5b40435e', '544e7b37-34ac-42c6-a973-4e3de7762947', '43a4df49-7816-4678-be36-250c471235e3', '4589a5a7-4543-448d-9e0a-cd5d1c274131', 'db3579e6-ea77-4102-ba19-0829034e0bac', '52365fff-e017-4d11-ba53-f5893d863536'} {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1065.099169] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1065.120966] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.121234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.121415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.121886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.122116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.122409] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1065.122409] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1065.122706] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1065.242498] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.242738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.242867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.243252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.244880] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.245422] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1065.245558] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1065.245665] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1065.245841] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1065.245887] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1065.245961] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGH for action security_group_rules [ 1065.246197] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: daa8b334-470d-4702-9560-94a964a51d78 with Priority: HIGH for action security_group_rules [ 1065.246197] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b7c1c93-5692-4546-9b54-4011872a824d with Priority: HIGH for action security_group_rules [ 1065.246387] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGH for action security_group_rules [ 1065.246387] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 721fd3df-fecb-47e7-86f0-25de8502794c with Priority: HIGH for action security_group_rules [ 1065.246573] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGH for action security_group_rules [ 1065.246573] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a with Priority: HIGH for action security_group_rules [ 1065.246649] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d with Priority: HIGH for action security_group_rules [ 1065.246751] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGH for action security_group_rules [ 1065.246805] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGH for action security_group_rules [ 1065.246882] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGH for action security_group_rules [ 1065.247020] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 with Priority: HIGH for action security_group_rules [ 1065.247107] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGH for action security_group_rules [ 1065.247197] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGH for action security_group_rules [ 1065.247262] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5b458df-8f8e-47b7-9e32-899c590c5940 with Priority: HIGH for action security_group_rules [ 1065.247344] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGH for action security_group_rules [ 1065.247459] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGH for action security_group_rules [ 1065.247555] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGH for action security_group_rules [ 1065.247665] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGH for action security_group_rules [ 1065.247777] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d with Priority: HIGH for action security_group_rules [ 1065.247927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.742726] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 in Status: SUCCESS [ 1065.743078] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.648132] env[65359]: INFO networking_nsxv3.common.synchronization [req-9b572c7b-5a18-4970-b36d-c2b41c03bdce req-211240f6-e94d-4a05-b436-016ed4b184d7 tempest-MultipleCreateTestJSON-875568090 tempest-MultipleCreateTestJSON-875568090-project-member] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 1068.648766] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 1068.648943] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09044820-85da-426b-b103-26678a0652e6 with Priority: HIGH for action security_group_rules [ 1068.649023] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7c1c93-5692-4546-9b54-4011872a824d with Priority: HIGH for action security_group_rules [ 1068.649122] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a with Priority: HIGH for action security_group_rules [ 1068.649608] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b458df-8f8e-47b7-9e32-899c590c5940 with Priority: HIGH for action security_group_rules [ 1068.649608] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d with Priority: HIGH for action security_group_rules [ 1068.649608] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGH for action security_group_rules [ 1068.649608] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153868d0-4b9a-4493-8289-08b4b26dc07b with Priority: HIGH for action security_group_rules [ 1068.649608] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655ee501-2055-483e-a130-4cf497421bd3 with Priority: HIGH for action security_group_rules [ 1068.649608] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc with Priority: HIGH for action security_group_rules [ 1068.649879] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGH for action security_group_rules [ 1068.649879] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGH for action security_group_rules [ 1068.649879] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 with Priority: HIGH for action security_group_rules [ 1068.650039] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGH for action security_group_rules [ 1068.650039] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99327ed1-6c09-451a-b316-eb0268988db2 with Priority: HIGH for action security_group_rules [ 1068.650202] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGH for action security_group_rules [ 1068.650253] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 with Priority: HIGH for action security_group_rules [ 1068.650309] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d with Priority: HIGH for action security_group_rules [ 1068.650386] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 721fd3df-fecb-47e7-86f0-25de8502794c with Priority: HIGH for action security_group_rules [ 1068.650466] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daa8b334-470d-4702-9560-94a964a51d78 with Priority: HIGH for action security_group_rules [ 1068.651096] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4b252c-75eb-46d7-adb1-3c832626f301 with Priority: HIGH for action security_group_rules [ 1068.651096] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.651096] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.651096] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.651385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.651385] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.651480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.651647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.651716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.651807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.652792] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.652945] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09044820-85da-426b-b103-26678a0652e6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.653026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.653026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.653334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.653334] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09044820-85da-426b-b103-26678a0652e6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.656465] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b7c1c93-5692-4546-9b54-4011872a824d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.656465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.656465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.656465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.656725] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b7c1c93-5692-4546-9b54-4011872a824d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.657332] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.657400] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.657458] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.658232] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.658232] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbe5a022-ed60-49c4-95a8-0a8fb4015b9a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.658672] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5b458df-8f8e-47b7-9e32-899c590c5940 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.658672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.658672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.658813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.658813] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5b458df-8f8e-47b7-9e32-899c590c5940',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.659974] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a269c68-1fd7-4085-a1d3-54f407762a6d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.659974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.659974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.659974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.659974] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a269c68-1fd7-4085-a1d3-54f407762a6d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.661015] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.661015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.661015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.661015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.661015] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.661770] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-153868d0-4b9a-4493-8289-08b4b26dc07b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.661868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.661926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.662355] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.662355] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('153868d0-4b9a-4493-8289-08b4b26dc07b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.662780] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-655ee501-2055-483e-a130-4cf497421bd3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.662877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.662934] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.663225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.663225] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('655ee501-2055-483e-a130-4cf497421bd3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.664408] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6eb7ac19-945a-427f-84cb-cc4a488527fc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.664408] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.664408] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.664408] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.664408] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6eb7ac19-945a-427f-84cb-cc4a488527fc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.666140] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.666140] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.666140] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.666140] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.666140] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.666722] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0a461a8-ce41-468d-b9bb-19fef2690b98 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.666837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.666873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.667059] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.667136] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0a461a8-ce41-468d-b9bb-19fef2690b98',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.667812] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.668282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.668282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.668446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.668446] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3711d124-9bf8-4fa4-9c53-ee6c21e9b344',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.669182] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.669281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.669342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.669659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.669659] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.670367] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99327ed1-6c09-451a-b316-eb0268988db2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.670442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.670600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.670663] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.670726] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99327ed1-6c09-451a-b316-eb0268988db2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.671495] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.671679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.671679] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.671854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.671943] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.672666] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.672779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.672885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.672999] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.673080] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f33a6cb0-88e0-45c4-8990-6da48fb9f1f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.674037] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.674198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.674198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.674372] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.674446] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.675215] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-721fd3df-fecb-47e7-86f0-25de8502794c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.675326] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.675377] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.675855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.675855] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('721fd3df-fecb-47e7-86f0-25de8502794c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.676340] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daa8b334-470d-4702-9560-94a964a51d78 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.676454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.676514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.677013] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.677013] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daa8b334-470d-4702-9560-94a964a51d78',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.678253] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac4b252c-75eb-46d7-adb1-3c832626f301 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.678253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.678253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.678441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.678441] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac4b252c-75eb-46d7-adb1-3c832626f301',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.985162] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.985454] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.985640] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.985967] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.986374] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.986943] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.988086] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.988341] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.988494] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.988709] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.988848] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1068.988971] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1068.989114] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1068.989367] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.989475] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1068.989613] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.011064] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.011310] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1069.011523] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.012165] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.012547] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-ebd1fd51-66c1-4434-88b5-b2e292d14d23 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.012547] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-ebd1fd51-66c1-4434-88b5-b2e292d14d23" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.012696] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-ebd1fd51-66c1-4434-88b5-b2e292d14d23" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.013038] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-ebd1fd51-66c1-4434-88b5-b2e292d14d23" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.013216] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebd1fd51-66c1-4434-88b5-b2e292d14d23',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.189308] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.189449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.189531] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.189714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.191039] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0a461a8-ce41-468d-b9bb-19fef2690b98 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.191223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.191223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.191399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.191616] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.191701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.191780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.191914] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.192051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.192181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.192237] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0a461a8-ce41-468d-b9bb-19fef2690b98',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.197575] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.197720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.197788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.198698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.198698] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.198698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.198698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.198698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.198698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.198698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.199063] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.250312] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.250561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.253450] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.253573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.254518] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.254667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.257880] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.258033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.262164] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.262319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.264453] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.264628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.265844] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.265977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.266931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.267204] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.267321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.267390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.267634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.267849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.267849] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be updated. [ 1069.268902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.269131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.271322] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.271449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.272289] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.272421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.273195] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.273280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.274527] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.274646] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.275317] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1069.275840] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.275964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.276733] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1069.277193] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.277344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.278029] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1069.278456] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.278577] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.279218] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1069.279626] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.279737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.281271] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1069.281707] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.281885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.284951] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1069.285419] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.285537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.287110] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1069.287526] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.287645] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.299245] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1069.299862] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.300055] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6eb7ac19-945a-427f-84cb-cc4a488527fc is going to be deleted. [ 1069.301231] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.301486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.306586] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.306729] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.306783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.306986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.307147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.316426] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: IN_PROGRESS for 2s [ 1069.326945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.327212] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbe5a022-ed60-49c4-95a8-0a8fb4015b9a is going to be deleted. [ 1069.328187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.328406] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.371518] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.371686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.374074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.374206] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5b458df-8f8e-47b7-9e32-899c590c5940 is going to be deleted. [ 1069.375832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.375832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.394743] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.394926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.400527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.400682] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b7c1c93-5692-4546-9b54-4011872a824d is going to be deleted. [ 1069.401668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.401910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.423172] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.423408] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be deleted. [ 1069.424347] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.424548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.469405] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.469611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.474520] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.474686] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d is going to be deleted. [ 1069.475696] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.476238] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.508225] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.508555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.516938] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.517392] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.517565] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.518064] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.518185] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.518480] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port ebd1fd51-66c1-4434-88b5-b2e292d14d23 not found, creating... [ 1069.518846] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.519352] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.519431] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.519872] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.520040] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.520467] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.520747] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.520944] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.521274] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.521489] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.521735] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: ebd1fd51-66c1-4434-88b5-b2e292d14d23 is going to be created. [ 1069.554662] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.554870] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3711d124-9bf8-4fa4-9c53-ee6c21e9b344 is going to be deleted. [ 1069.555820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.556095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.597205] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.597473] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.597992] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.597992] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.598157] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.598416] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-ebd1fd51-66c1-4434-88b5-b2e292d14d23" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.604181] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.604391] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.607031] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.607207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.607947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.608083] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be deleted. [ 1069.609035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.609257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.667403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.667811] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 153868d0-4b9a-4493-8289-08b4b26dc07b is going to be deleted. [ 1069.668797] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.669628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.716564] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.717914] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0a461a8-ce41-468d-b9bb-19fef2690b98',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.746171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.746315] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99327ed1-6c09-451a-b316-eb0268988db2 is going to be deleted. [ 1069.747338] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.747572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.754901] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.755015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.810716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.810857] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f33a6cb0-88e0-45c4-8990-6da48fb9f1f5 is going to be deleted. [ 1069.811972] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.812360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.821548] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.821694] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.900902] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.901165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.905482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.905664] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac4b252c-75eb-46d7-adb1-3c832626f301 is going to be deleted. [ 1069.906740] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.906977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.942595] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.942743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.957627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.957900] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 721fd3df-fecb-47e7-86f0-25de8502794c is going to be deleted. [ 1069.958933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.959203] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.998742] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.998921] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.003898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.004059] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be deleted. [ 1070.005146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.005410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.032286] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.032467] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.050497] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.050708] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09044820-85da-426b-b103-26678a0652e6 is going to be deleted. [ 1070.051865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.052159] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.079303] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.079512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.082723] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.082918] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 655ee501-2055-483e-a130-4cf497421bd3 is going to be deleted. [ 1070.084193] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.084439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.131022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.131022] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daa8b334-470d-4702-9560-94a964a51d78 is going to be deleted. [ 1070.131022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.131022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.148523] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.148673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.200413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.200615] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a269c68-1fd7-4085-a1d3-54f407762a6d is going to be deleted. [ 1070.201786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.202081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.202230] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.202424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6eb7ac19-945a-427f-84cb-cc4a488527fc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.202899] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.202899] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.203036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.203144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbe5a022-ed60-49c4-95a8-0a8fb4015b9a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.203798] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.203992] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.204140] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.204304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5b458df-8f8e-47b7-9e32-899c590c5940" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.204471] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.204666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.204817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.204986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b7c1c93-5692-4546-9b54-4011872a824d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.205180] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.205368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.205471] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.205622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.205798] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.205956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.206119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.206473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba0bbaf5-0aab-4f71-bb8f-4080a1faeb4d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.206647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.206846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.206939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.207129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3711d124-9bf8-4fa4-9c53-ee6c21e9b344" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.207287] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.207464] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.207533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.207698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.207936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.208066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.208169] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.208305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-153868d0-4b9a-4493-8289-08b4b26dc07b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.208476] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.208656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.208765] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.208908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99327ed1-6c09-451a-b316-eb0268988db2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.209086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.209264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.209336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.209486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f33a6cb0-88e0-45c4-8990-6da48fb9f1f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.209674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.209848] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.209926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.210087] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac4b252c-75eb-46d7-adb1-3c832626f301" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.210269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.210431] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.210510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.210622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-721fd3df-fecb-47e7-86f0-25de8502794c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.210750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.210889] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.210959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.211098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.219460] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.219654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.219732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.219913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.220015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.220149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09044820-85da-426b-b103-26678a0652e6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.220392] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3577cfc-adec-4c56-bc24-6acdb8887663: rpc.has_security_group_logging(os_id): False [ 1070.221454] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0a461a8-ce41-468d-b9bb-19fef2690b98: rpc.has_security_group_logging(os_id): False [ 1070.222951] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.223089] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.223150] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.223356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.223445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.223560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-655ee501-2055-483e-a130-4cf497421bd3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.249276] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.249450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.249569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.249811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.249931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.250112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daa8b334-470d-4702-9560-94a964a51d78" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.262964] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.263149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.263658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.263658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.265487] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.265678] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.274874] env[65359]: INFO networking_nsxv3.common.synchronization [req-9b572c7b-5a18-4970-b36d-c2b41c03bdce req-a72eefe7-bb46-4717-858e-363bef7e787b service nova] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_rules [ 1070.275134] env[65359]: INFO networking_nsxv3.common.synchronization [req-9b572c7b-5a18-4970-b36d-c2b41c03bdce req-a72eefe7-bb46-4717-858e-363bef7e787b service nova] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 1070.275319] env[65359]: INFO networking_nsxv3.common.synchronization [req-9b572c7b-5a18-4970-b36d-c2b41c03bdce req-a72eefe7-bb46-4717-858e-363bef7e787b service nova] Enqueued Resource ID: ebd1fd51-66c1-4434-88b5-b2e292d14d23 with Priority: HIGHEST for action port [ 1070.275892] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_rules [ 1070.276148] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 1070.276148] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd1fd51-66c1-4434-88b5-b2e292d14d23 with Priority: HIGHEST for action port [ 1070.276409] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.276745] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.276745] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.277077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.277077] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.277812] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.277920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.278171] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebd1fd51-66c1-4434-88b5-b2e292d14d23 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.278301] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebd1fd51-66c1-4434-88b5-b2e292d14d23" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.278301] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebd1fd51-66c1-4434-88b5-b2e292d14d23" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.278749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebd1fd51-66c1-4434-88b5-b2e292d14d23" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.278749] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebd1fd51-66c1-4434-88b5-b2e292d14d23',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.291738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.292582] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.292582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.292582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.292582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.292961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.292961] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 is going to be updated. [ 1070.293966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.294329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.326448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.327219] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.327219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.327219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.327219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.327612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.327612] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 is going to be updated. [ 1070.332662] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.332865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.332865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.333079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.333166] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.333282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a269c68-1fd7-4085-a1d3-54f407762a6d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.412519] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.412807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.412807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.413108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.413342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.433666] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: IN_PROGRESS for 2s [ 1070.453331] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1070.454602] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.455277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.455998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.455998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.456223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.472525] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 in Status: IN_PROGRESS for 2s [ 1070.781924] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.782249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.782392] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebd1fd51-66c1-4434-88b5-b2e292d14d23 with status ACTIVE [ 1070.782549] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.783256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.783256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.783256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.783256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.783464] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.783570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.783643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.784016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.784133] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.784332] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.784437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.784502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.784660] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.784771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.784858] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebd1fd51-66c1-4434-88b5-b2e292d14d23 is going to be updated. [ 1070.826975] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.827189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.827286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.827533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.827712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.827924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebd1fd51-66c1-4434-88b5-b2e292d14d23" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.149443] env[65359]: INFO networking_nsxv3.common.synchronization [req-9b572c7b-5a18-4970-b36d-c2b41c03bdce req-ddee8d1b-a71d-46c3-ae2d-3bce70cc1b89 tempest-MultipleCreateTestJSON-875568090 tempest-MultipleCreateTestJSON-875568090-project-member] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 1071.150162] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 1071.150897] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.150897] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.327319] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 1071.327525] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 deletion is rescheduled due to dependency. [ 1071.327673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.327944] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.328225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.328446] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.328565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.328669] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.328851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.328959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.329096] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.551528] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.551676] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.551806] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.552147] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.552330] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.552485] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.552599] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.552828] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.552986] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.553424] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.553553] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1071.553666] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1071.553795] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1071.553931] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.554050] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1071.554187] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1071.573637] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1071.577020] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1071.577020] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1071.577020] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-513" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.577020] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-250d162a-73ba-4906-9625-ad13a592e632 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.577020] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-250d162a-73ba-4906-9625-ad13a592e632" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.577020] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-250d162a-73ba-4906-9625-ad13a592e632" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.577020] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-250d162a-73ba-4906-9625-ad13a592e632" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.577020] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('250d162a-73ba-4906-9625-ad13a592e632',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.831317] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.078188] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.078434] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.078565] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.078862] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.079030] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.079196] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 250d162a-73ba-4906-9625-ad13a592e632 not found, creating... [ 1072.079470] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.079626] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.079744] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.079971] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.080122] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.080406] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.080589] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.080708] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.080870] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.080997] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.081167] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 250d162a-73ba-4906-9625-ad13a592e632 is going to be created. [ 1072.109588] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.110072] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.111822] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.111822] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.111822] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.111822] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-250d162a-73ba-4906-9625-ad13a592e632" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.334299] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.449208] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: SUCCESS [ 1072.449543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.489901] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 in Status: SUCCESS [ 1072.490262] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.838604] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.838917] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.838917] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.839098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.839160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.839258] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be updated. [ 1072.850127] env[65359]: INFO networking_nsxv3.common.synchronization [req-9b572c7b-5a18-4970-b36d-c2b41c03bdce req-c7b89bd6-7983-4ce2-9a87-751355378271 service nova] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_rules [ 1072.850335] env[65359]: INFO networking_nsxv3.common.synchronization [req-9b572c7b-5a18-4970-b36d-c2b41c03bdce req-c7b89bd6-7983-4ce2-9a87-751355378271 service nova] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 1072.850605] env[65359]: INFO networking_nsxv3.common.synchronization [req-9b572c7b-5a18-4970-b36d-c2b41c03bdce req-c7b89bd6-7983-4ce2-9a87-751355378271 service nova] Enqueued Resource ID: 250d162a-73ba-4906-9625-ad13a592e632 with Priority: HIGHEST for action port [ 1072.853307] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_rules [ 1072.853534] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 1072.853590] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250d162a-73ba-4906-9625-ad13a592e632 with Priority: HIGHEST for action port [ 1072.856180] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.856331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.856639] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.856739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.856935] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-250d162a-73ba-4906-9625-ad13a592e632 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.857058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-250d162a-73ba-4906-9625-ad13a592e632" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.857142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-250d162a-73ba-4906-9625-ad13a592e632" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.857351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-250d162a-73ba-4906-9625-ad13a592e632" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.857435] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('250d162a-73ba-4906-9625-ad13a592e632',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.956400] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.956652] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.956720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.956935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.957138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.977750] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: IN_PROGRESS for 2s [ 1073.362274] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 250d162a-73ba-4906-9625-ad13a592e632 with status ACTIVE [ 1073.362364] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.362494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.362576] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.362780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.362838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.363099] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.363213] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.363213] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.363341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.363397] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.363579] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.363678] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.363743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.363888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.364064] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.364064] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 250d162a-73ba-4906-9625-ad13a592e632 is going to be updated. [ 1073.386735] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.386735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.386735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.386735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.386735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.386735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-250d162a-73ba-4906-9625-ad13a592e632" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.689886] env[65359]: INFO networking_nsxv3.common.synchronization [req-b03f607e-8e26-4fb1-9527-b62fc6045a96 req-fa24ab97-ca87-4e09-9570-415a6172e4dd tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_members [ 1073.690170] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_members [ 1073.690296] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.690423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.690493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.690736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.690892] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.691022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.691194] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.691364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.691510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.691608] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.014270] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.014270] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.014899] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.015332] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.015703] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.016043] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.016276] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.017091] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.017339] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.017635] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.017854] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.018054] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.018243] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.018425] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.018668] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.018877] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.038538] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.038711] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.038847] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.039030] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.039356] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-269f724c-dc79-44e1-8689-20a795469fe9 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.039534] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-269f724c-dc79-44e1-8689-20a795469fe9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.039654] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-269f724c-dc79-44e1-8689-20a795469fe9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.039974] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-269f724c-dc79-44e1-8689-20a795469fe9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.040127] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('269f724c-dc79-44e1-8689-20a795469fe9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.194594] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.195092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.195092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.195189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.195551] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.195551] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.195551] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.195691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.195933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.195933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.195933] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 already deleted. [ 1074.196034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.542674] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.542906] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.543123] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.543490] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.544605] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.545027] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 269f724c-dc79-44e1-8689-20a795469fe9 not found, creating... [ 1074.545362] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.545553] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.545695] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.545936] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.546088] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.546401] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.546631] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.546706] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.546881] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.547024] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.547161] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 269f724c-dc79-44e1-8689-20a795469fe9 is going to be created. [ 1074.569873] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.570147] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.570240] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.570564] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.570849] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.571663] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-269f724c-dc79-44e1-8689-20a795469fe9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.989868] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 1074.990119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.990298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.990526] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.990732] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.990882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.990961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.991144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.991224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.991309] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.991412] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.992281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.992752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.992928] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.993088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.993159] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.993336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.993416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.993507] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.274271] env[65359]: INFO networking_nsxv3.common.synchronization [req-b03f607e-8e26-4fb1-9527-b62fc6045a96 req-a96956c0-9a89-47d8-9322-8d3483811cd8 service nova] Enqueued Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_rules [ 1075.274521] env[65359]: INFO networking_nsxv3.common.synchronization [req-b03f607e-8e26-4fb1-9527-b62fc6045a96 req-a96956c0-9a89-47d8-9322-8d3483811cd8 service nova] Enqueued Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_members [ 1075.274901] env[65359]: INFO networking_nsxv3.common.synchronization [req-b03f607e-8e26-4fb1-9527-b62fc6045a96 req-a96956c0-9a89-47d8-9322-8d3483811cd8 service nova] Enqueued Resource ID: 269f724c-dc79-44e1-8689-20a795469fe9 with Priority: HIGHEST for action port [ 1075.275682] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_rules [ 1075.276038] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_members [ 1075.276206] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 269f724c-dc79-44e1-8689-20a795469fe9 with Priority: HIGHEST for action port [ 1075.276522] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.276855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.276964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.277253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.277369] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.279241] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.279425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.279544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.279817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.280098] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.280259] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.280356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.280590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.280715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.280900] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.281909] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-269f724c-dc79-44e1-8689-20a795469fe9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.282055] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-269f724c-dc79-44e1-8689-20a795469fe9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.282104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-269f724c-dc79-44e1-8689-20a795469fe9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.282306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-269f724c-dc79-44e1-8689-20a795469fe9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.282355] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('269f724c-dc79-44e1-8689-20a795469fe9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.495048] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.495188] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.497541] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.786894] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.786894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.786894] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.786894] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 269f724c-dc79-44e1-8689-20a795469fe9 with status ACTIVE [ 1075.786894] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.786894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.786894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.786894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.786894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.787403] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.787403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.787403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.787403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.787584] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.788831] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.788831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.788831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.788831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.788831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.789617] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 269f724c-dc79-44e1-8689-20a795469fe9 is going to be updated. [ 1075.813707] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.813829] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.813877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.814154] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.814260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.814419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-269f724c-dc79-44e1-8689-20a795469fe9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.002556] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.294415] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.508493] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.508493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.508493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.508493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.508493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.508493] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be updated. [ 1076.543145] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.543225] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.543264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.543481] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.544195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.562730] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: IN_PROGRESS for 2s [ 1076.799570] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.799930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.799930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.800066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.800483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.800483] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 is going to be created. [ 1076.831350] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.831350] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.831602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.831664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.832150] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.845245] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: UNINITIALIZED for 2s [ 1078.575395] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 1078.575395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.575395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.575395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.575395] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.575395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.575395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.575395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.575395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.575395] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.859513] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: SUCCESS [ 1078.859766] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.859949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.860187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.860456] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.860574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.860574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.860754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.860832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.860913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.861015] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.928828] env[65359]: INFO networking_nsxv3.common.synchronization [req-cf9c48c6-804c-4373-9147-d61dfc8437f8 req-f5af6bcb-8aca-47ab-a84a-590ec9705e89 tempest-ServerDiskConfigTestJSON-2085995032 tempest-ServerDiskConfigTestJSON-2085995032-project-member] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 1078.929428] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 1078.929752] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.929891] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.929955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.930253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.930413] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.930511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.930574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.930753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.930952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.930952] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.080285] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.365175] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.400970] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-346 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.401482] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.401731] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.402156] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.402599] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.402964] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.403099] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.403465] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.403733] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.404098] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.404312] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.404508] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.404702] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.404890] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.405358] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.405702] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.429901] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.430120] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1079.430198] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.430582] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-346" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.430977] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-f62a209e-f9e7-4ba9-b7f3-02fa21e809f8 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.431253] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-f62a209e-f9e7-4ba9-b7f3-02fa21e809f8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.431503] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-f62a209e-f9e7-4ba9-b7f3-02fa21e809f8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.431783] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-f62a209e-f9e7-4ba9-b7f3-02fa21e809f8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.431957] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f62a209e-f9e7-4ba9-b7f3-02fa21e809f8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.437185] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.437185] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.437185] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.437390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.437390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.437542] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.438237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.438237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.438237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.438237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.438237] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be deleted. [ 1079.473063] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.473256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.473342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.473594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.473721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.473920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.581318] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.867048] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6599e228-9d5e-4d59-9a87-ffa7ce620eb9: rpc.has_security_group_logging(os_id): False [ 1079.887284] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.887480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.887547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.887710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.887820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.888147] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.888249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.888307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.888479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.888553] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.889288] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 is going to be created. [ 1079.934367] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.934653] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.934827] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.935268] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.935386] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.935568] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port f62a209e-f9e7-4ba9-b7f3-02fa21e809f8 not found, creating... [ 1079.935909] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.936173] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.936363] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.936670] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.936850] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.943391] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.943824] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.943885] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.944139] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.944313] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.944453] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: f62a209e-f9e7-4ba9-b7f3-02fa21e809f8 is going to be created. [ 1079.958071] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.958071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.958071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.958071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.958421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.968228] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.968501] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.968662] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.969083] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.969453] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.969878] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-f62a209e-f9e7-4ba9-b7f3-02fa21e809f8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.972973] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: IN_PROGRESS for 2s [ 1080.084206] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.084388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.084462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.084701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.084780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.084912] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be updated. [ 1080.146339] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.146521] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.146580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.146866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.147015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.159638] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: IN_PROGRESS for 2s [ 1080.792064] env[65359]: INFO networking_nsxv3.common.synchronization [req-cf9c48c6-804c-4373-9147-d61dfc8437f8 req-9d147fca-45e7-4b9e-9da1-48caf5bee3f2 service nova] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_rules [ 1080.792296] env[65359]: INFO networking_nsxv3.common.synchronization [req-cf9c48c6-804c-4373-9147-d61dfc8437f8 req-9d147fca-45e7-4b9e-9da1-48caf5bee3f2 service nova] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 1080.792411] env[65359]: INFO networking_nsxv3.common.synchronization [req-cf9c48c6-804c-4373-9147-d61dfc8437f8 req-9d147fca-45e7-4b9e-9da1-48caf5bee3f2 service nova] Enqueued Resource ID: f62a209e-f9e7-4ba9-b7f3-02fa21e809f8 with Priority: HIGHEST for action port [ 1080.793017] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_rules [ 1080.793936] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 1080.794126] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f62a209e-f9e7-4ba9-b7f3-02fa21e809f8 with Priority: HIGHEST for action port [ 1080.794501] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.794669] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.794769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.795043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.795199] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.796810] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.797153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.797689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.797986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.798220] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.799077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.799234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.799442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.799558] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.799690] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.801608] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-f62a209e-f9e7-4ba9-b7f3-02fa21e809f8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.802416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f62a209e-f9e7-4ba9-b7f3-02fa21e809f8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.802501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f62a209e-f9e7-4ba9-b7f3-02fa21e809f8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.802752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f62a209e-f9e7-4ba9-b7f3-02fa21e809f8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.802887] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f62a209e-f9e7-4ba9-b7f3-02fa21e809f8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.302074] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.306224] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.306224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.312369] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f62a209e-f9e7-4ba9-b7f3-02fa21e809f8 with status ACTIVE [ 1081.312369] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.312369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.312369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.312369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.312778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.312778] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.312778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.312778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.315737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.315737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.315737] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.315737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.315737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.315737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.315737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.315737] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f62a209e-f9e7-4ba9-b7f3-02fa21e809f8 is going to be updated. [ 1081.343179] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.343387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.343387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.343535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.343695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.343974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f62a209e-f9e7-4ba9-b7f3-02fa21e809f8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.804390] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.986012] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: SUCCESS [ 1081.986487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.172371] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 1082.172630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.172809] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.173060] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.173297] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.173422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.173490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.173654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.173737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.173866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.174086] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.174208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.174291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.174394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.174531] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.174639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.174710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.174852] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.174929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.175019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.175362] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.306940] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.307275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.307275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.307535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.307708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.307823] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be created. [ 1082.341319] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.341479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.341572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.341802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.342011] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.355644] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: UNINITIALIZED for 2s [ 1082.603213] env[65359]: INFO networking_nsxv3.common.synchronization [req-0f60cc26-ed5b-447c-bf13-413e74690367 req-e3b3a4cf-4792-41d7-b3fb-97d70487f2ed tempest-DeleteServersTestJSON-2065668722 tempest-DeleteServersTestJSON-2065668722-project-member] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1082.604948] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1082.604948] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.605708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.605708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.605708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.605837] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.605968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.606084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.606625] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.606625] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.607020] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.679099] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4589a5a7-4543-448d-9e0a-cd5d1c274131: rpc.has_security_group_logging(os_id): False [ 1082.697119] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.697288] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.697362] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.697576] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.697667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.697886] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.698017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.698094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.698263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.698360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.698593] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.698698] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.698762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.698920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.699009] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.699199] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.699536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.699536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.699618] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.699687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.699843] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be updated. [ 1082.795243] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.795243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.795243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.795243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.795243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.819110] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: IN_PROGRESS for 2s [ 1083.020284] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-125 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.020509] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.020656] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.020927] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.021210] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.021409] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.021482] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.021755] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.021945] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.022201] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.022316] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.022425] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.023097] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.023335] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.023494] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.023651] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.051520] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.051733] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1083.051995] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.052248] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.052523] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-48a4c1cc-59a7-48ad-aa3c-b0f4771c4576 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.052720] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-48a4c1cc-59a7-48ad-aa3c-b0f4771c4576" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.052910] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-48a4c1cc-59a7-48ad-aa3c-b0f4771c4576" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.053448] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-48a4c1cc-59a7-48ad-aa3c-b0f4771c4576" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.053587] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48a4c1cc-59a7-48ad-aa3c-b0f4771c4576',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.104459] env[65359]: INFO networking_nsxv3.common.synchronization [req-f60fb38e-ecdc-4e3d-8b8f-273d6448aeda req-e98275ff-7c33-4283-9941-20872f07d093 tempest-ServerRescueNegativeTestJSON-174363340 tempest-ServerRescueNegativeTestJSON-174363340-project-member] Enqueued Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_members [ 1083.105247] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_members [ 1083.105560] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.105717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.105769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.106011] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.106565] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.106686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.106747] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.106927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.107040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.107184] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.109184] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.109327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.109399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.109578] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.109710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.109909] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.110108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.110108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.110265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.110342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.110427] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be deleted. [ 1083.146891] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.147078] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.147120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.147779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.147779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.147779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.559031] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.559031] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.559031] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.559031] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.559031] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.559031] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 48a4c1cc-59a7-48ad-aa3c-b0f4771c4576 not found, creating... [ 1083.559031] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.559031] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.559031] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.559031] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.559031] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.559868] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.559868] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.560257] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.560642] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.562931] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.562931] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 48a4c1cc-59a7-48ad-aa3c-b0f4771c4576 is going to be created. [ 1083.585035] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.585035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.585035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.585035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.585035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.585035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-48a4c1cc-59a7-48ad-aa3c-b0f4771c4576" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.613067] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.116501] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.332325] env[65359]: INFO networking_nsxv3.common.synchronization [req-0f60cc26-ed5b-447c-bf13-413e74690367 req-b8fdc328-50ca-4f68-afd8-ebffced4bc41 service nova] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_rules [ 1084.332325] env[65359]: INFO networking_nsxv3.common.synchronization [req-0f60cc26-ed5b-447c-bf13-413e74690367 req-b8fdc328-50ca-4f68-afd8-ebffced4bc41 service nova] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1084.332325] env[65359]: INFO networking_nsxv3.common.synchronization [req-0f60cc26-ed5b-447c-bf13-413e74690367 req-b8fdc328-50ca-4f68-afd8-ebffced4bc41 service nova] Enqueued Resource ID: 48a4c1cc-59a7-48ad-aa3c-b0f4771c4576 with Priority: HIGHEST for action port [ 1084.332325] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_rules [ 1084.332325] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1084.332602] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48a4c1cc-59a7-48ad-aa3c-b0f4771c4576 with Priority: HIGHEST for action port [ 1084.332973] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.333237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.333344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.333618] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.333757] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.335127] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.335246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.335340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.335529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.335676] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.335837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.335928] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.336149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.336249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.336384] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.338623] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-48a4c1cc-59a7-48ad-aa3c-b0f4771c4576 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.338623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48a4c1cc-59a7-48ad-aa3c-b0f4771c4576" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.338623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48a4c1cc-59a7-48ad-aa3c-b0f4771c4576" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.338623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48a4c1cc-59a7-48ad-aa3c-b0f4771c4576" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.338623] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48a4c1cc-59a7-48ad-aa3c-b0f4771c4576',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.367791] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 1084.367791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.368281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.368612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.368741] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.368858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.368926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.369101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.369180] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.369268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.369361] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.620068] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.620259] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.620358] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.620579] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.620674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.620779] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4a73e88-8afb-4866-a66b-2583f493db5e is going to be updated. [ 1084.654604] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.654775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.654813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.655081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.655230] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.668870] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4a73e88-8afb-4866-a66b-2583f493db5e in Status: IN_PROGRESS for 2s [ 1084.695478] env[65359]: INFO networking_nsxv3.common.synchronization [req-da191284-5abc-4139-9a58-8d384f1040cf req-e6688cf2-cc09-4dbe-8596-83f930792010 tempest-MultipleCreateTestJSON-875568090 tempest-MultipleCreateTestJSON-875568090-project-member] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 1084.696027] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 1084.696523] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.696523] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.696633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.696731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.696879] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.697073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.697139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.697289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.697374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.697468] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.842438] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 1084.842438] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.842438] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.842438] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.842438] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.847750] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48a4c1cc-59a7-48ad-aa3c-b0f4771c4576 with status ACTIVE [ 1084.847971] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.848116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.848181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.848407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.848599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.848666] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.848764] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.848826] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.849248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.849248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.849248] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.849392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.849392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.849517] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.849588] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.849676] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48a4c1cc-59a7-48ad-aa3c-b0f4771c4576 is going to be updated. [ 1084.850725] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.853383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.853383] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.872598] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.872598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.872598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.872732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.873386] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.873602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.873602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.873742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.873873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.874017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.875697] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.875697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.875777] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.875945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.879505] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.879625] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.879693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.879856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.880582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.880582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.880582] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.882286] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.882406] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.882480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.882646] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.882797] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.883066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48a4c1cc-59a7-48ad-aa3c-b0f4771c4576" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.038721] env[65359]: INFO networking_nsxv3.common.synchronization [req-2e8fa9b1-c646-4d3e-a9bc-a0f2709e045b req-c9b1102f-61c8-49e4-80b2-50aa5f26fbb3 tempest-MultipleCreateTestJSON-875568090 tempest-MultipleCreateTestJSON-875568090-project-member] Enqueued Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 1085.038721] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 with Priority: HIGHEST for action security_group_members [ 1085.038853] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.038901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.134684] env[65359]: INFO networking_nsxv3.common.synchronization [req-4d9dcf4d-f913-4576-adb8-81ce052b5439 req-a866df84-6d91-4bf3-b279-a45905845f19 tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: 13736951-03c6-4d53-ad2b-da3bf377face with Priority: HIGHEST for action security_group_members [ 1085.135231] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13736951-03c6-4d53-ad2b-da3bf377face with Priority: HIGHEST for action security_group_members [ 1085.135231] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-13736951-03c6-4d53-ad2b-da3bf377face taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.135369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.135398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.135632] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.135789] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.135888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.135951] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.136226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.136256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.136358] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13736951-03c6-4d53-ad2b-da3bf377face',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.199372] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.352581] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.354056] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.354173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.384938] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4dca704-f8c2-494f-bbf6-802020c49b4b: rpc.has_security_group_logging(os_id): False [ 1085.404843] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.405061] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.405244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.405433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.406103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.406103] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.406103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.406103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.406394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.406394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.406903] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.407037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.407291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.407291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.407386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.407535] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.407629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.407692] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.407831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.407906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.407993] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be created. [ 1085.467690] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.467822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.467898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.468149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.468376] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.483493] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: IN_PROGRESS for 2s [ 1085.485506] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.485684] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.485804] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.486308] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.486411] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.487677] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.487677] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.487677] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.487677] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.487677] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.487677] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.487677] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.487677] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.487677] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.488102] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.488102] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.507705] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.507872] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1085.508020] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.508205] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.508554] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-3e992ce9-420f-48d6-a729-133d6c08e277 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.508728] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-3e992ce9-420f-48d6-a729-133d6c08e277" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.508842] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-3e992ce9-420f-48d6-a729-133d6c08e277" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.509192] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-3e992ce9-420f-48d6-a729-133d6c08e277" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.510894] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e992ce9-420f-48d6-a729-133d6c08e277',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.638743] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.638910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.638986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.639223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.639317] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.639518] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.639638] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.639704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.639853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.639928] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.640021] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13736951-03c6-4d53-ad2b-da3bf377face already deleted. [ 1085.640123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.706298] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.855943] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.856123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.856196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.856431] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.856524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.856626] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be created. [ 1085.884547] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.884547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.884547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.884547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.884547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.894990] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: UNINITIALIZED for 2s [ 1086.016012] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.016196] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.016375] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.016695] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.016854] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.017022] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 3e992ce9-420f-48d6-a729-133d6c08e277 not found, creating... [ 1086.017276] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.017437] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.017557] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.017767] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.017934] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.018357] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.018531] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.018687] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.018950] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.019114] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.019257] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 3e992ce9-420f-48d6-a729-133d6c08e277 is going to be created. [ 1086.038900] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.039141] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.039268] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.039539] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.039784] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.040016] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-3e992ce9-420f-48d6-a729-133d6c08e277" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.210535] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.210535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.210535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.210535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.210535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.210535] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be updated. [ 1086.241334] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.241525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.241574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.242349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.242349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.254702] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: IN_PROGRESS for 2s [ 1086.682281] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4a73e88-8afb-4866-a66b-2583f493db5e in Status: SUCCESS [ 1086.682940] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.800848] env[65359]: INFO networking_nsxv3.common.synchronization [req-4d9dcf4d-f913-4576-adb8-81ce052b5439 req-40791500-2398-4afb-bf10-e349f7284aa2 service nova] Enqueued Resource ID: 13736951-03c6-4d53-ad2b-da3bf377face with Priority: HIGHEST for action security_group_rules [ 1086.800848] env[65359]: INFO networking_nsxv3.common.synchronization [req-4d9dcf4d-f913-4576-adb8-81ce052b5439 req-40791500-2398-4afb-bf10-e349f7284aa2 service nova] Enqueued Resource ID: 13736951-03c6-4d53-ad2b-da3bf377face with Priority: HIGHEST for action security_group_members [ 1086.800848] env[65359]: INFO networking_nsxv3.common.synchronization [req-4d9dcf4d-f913-4576-adb8-81ce052b5439 req-40791500-2398-4afb-bf10-e349f7284aa2 service nova] Enqueued Resource ID: 3e992ce9-420f-48d6-a729-133d6c08e277 with Priority: HIGHEST for action port [ 1086.802530] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13736951-03c6-4d53-ad2b-da3bf377face with Priority: HIGHEST for action security_group_rules [ 1086.802530] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13736951-03c6-4d53-ad2b-da3bf377face with Priority: HIGHEST for action security_group_members [ 1086.802530] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e992ce9-420f-48d6-a729-133d6c08e277 with Priority: HIGHEST for action port [ 1086.802530] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13736951-03c6-4d53-ad2b-da3bf377face taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.802530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.802530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.802530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.802530] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13736951-03c6-4d53-ad2b-da3bf377face',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.803843] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-13736951-03c6-4d53-ad2b-da3bf377face taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.803843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.803843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.803843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.803843] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.804142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.804142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.804196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.804236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.804527] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13736951-03c6-4d53-ad2b-da3bf377face',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.805778] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e992ce9-420f-48d6-a729-133d6c08e277 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.805778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e992ce9-420f-48d6-a729-133d6c08e277" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.805778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e992ce9-420f-48d6-a729-133d6c08e277" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.805939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e992ce9-420f-48d6-a729-133d6c08e277" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.805971] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e992ce9-420f-48d6-a729-133d6c08e277',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.308471] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-13736951-03c6-4d53-ad2b-da3bf377face taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.308471] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.308471] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13736951-03c6-4d53-ad2b-da3bf377face',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.309732] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e992ce9-420f-48d6-a729-133d6c08e277 with status ACTIVE [ 1087.309941] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.310086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.311031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.311031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.311031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.311031] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.311031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.311031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.311031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.311419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.312025] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.312025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.312025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.312025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.312025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.312288] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e992ce9-420f-48d6-a729-133d6c08e277 is going to be updated. [ 1087.340141] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.340286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.340286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.341051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.341051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.341051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e992ce9-420f-48d6-a729-133d6c08e277" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.560940] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 1087.561216] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.813944] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13736951-03c6-4d53-ad2b-da3bf377face',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.906212] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 1087.906345] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.907031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.907031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.907031] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.907284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.907284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.907484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.907568] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.907651] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.907739] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.265539] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 1088.265937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.266146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.266414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.266595] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.266709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.266792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.266926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.266986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.267089] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.317739] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.317739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.317739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.317739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.317739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.318660] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13736951-03c6-4d53-ad2b-da3bf377face is going to be created. [ 1088.343429] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.343621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.343690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.344115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.344115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.354616] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13736951-03c6-4d53-ad2b-da3bf377face in Status: UNINITIALIZED for 2s [ 1088.410292] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.410516] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.410577] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.410776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.410986] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.411080] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.411138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.411275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.412926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.412926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.412926] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.412926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.412926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.412926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.412926] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.412926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.412926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.412926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.412926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.412926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.413371] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.769196] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.769405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.769498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.770071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.770071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.770298] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.770460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.770564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.770813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.770919] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.771062] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be updated. [ 1088.809941] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.810193] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.810251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.814266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.814266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.839563] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: IN_PROGRESS for 2s [ 1088.915467] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6b655ed-9de5-4842-96d3-3652c9e45ddb: rpc.has_security_group_logging(os_id): False [ 1088.937477] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.937477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.937634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.937785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.937879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.938116] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.938229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.938304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.938435] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.939031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.939031] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.939031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.939031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.939031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.939593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.939593] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.939593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.939593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.939593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.939783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.939783] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be created. [ 1089.003041] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.003041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.003041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.003389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.003389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.019324] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 1090.365939] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13736951-03c6-4d53-ad2b-da3bf377face in Status: SUCCESS [ 1090.365939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.366412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.366412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.366521] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.366658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.366726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.367517] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.367517] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.367517] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.367517] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13736951-03c6-4d53-ad2b-da3bf377face',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.854450] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 1090.854676] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 deletion is rescheduled due to dependency. [ 1090.855530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.855530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.855530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.855737] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.855896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.855896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.856092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.856228] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.856775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.856946] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.869175] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13736951-03c6-4d53-ad2b-da3bf377face',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.039867] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 1091.039867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.359516] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.359686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.359760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.360223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.360458] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.360610] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.361573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.361839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.361973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.362085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.362262] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-4589a5a7-4543-448d-9e0a-cd5d1c274131 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.362382] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.362432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.362595] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.362795] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.362869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.362906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.365308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.365490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.365612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.365716] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4589a5a7-4543-448d-9e0a-cd5d1c274131',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.371270] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13736951-03c6-4d53-ad2b-da3bf377face: rpc.has_security_group_logging(os_id): False [ 1091.394241] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.394241] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.394385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.395048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.395048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.395048] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.395048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.395332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.395332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.395332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.395452] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13736951-03c6-4d53-ad2b-da3bf377face is going to be created. [ 1091.467985] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.469246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.469246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.471685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.472097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.486790] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13736951-03c6-4d53-ad2b-da3bf377face in Status: IN_PROGRESS for 2s [ 1091.802366] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1091.802502] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1091.871370] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4589a5a7-4543-448d-9e0a-cd5d1c274131: rpc.has_security_group_logging(os_id): False [ 1091.894162] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.894321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.894388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.894603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.894950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.895239] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.896139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.896139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.896139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.896139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.896139] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.896139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.896139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.896425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.896425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.896596] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.896709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.896779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.896962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.897081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.897194] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 is going to be updated. [ 1092.002095] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.002095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.002095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.002095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.002095] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.026453] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: IN_PROGRESS for 2s [ 1092.280250] env[65359]: INFO networking_nsxv3.common.synchronization [None req-d2608b4c-6ced-4f06-b0d3-6be111a43c5a None None] Enqueued Resource ID: 99cd336f-c85c-4bce-abf8-1731eda3f403 with Priority: HIGHEST for action port [ 1092.280905] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99cd336f-c85c-4bce-abf8-1731eda3f403 with Priority: HIGHEST for action port [ 1092.281576] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-99cd336f-c85c-4bce-abf8-1731eda3f403 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.281738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99cd336f-c85c-4bce-abf8-1731eda3f403" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.281835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99cd336f-c85c-4bce-abf8-1731eda3f403" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.282203] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99cd336f-c85c-4bce-abf8-1731eda3f403" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.282340] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99cd336f-c85c-4bce-abf8-1731eda3f403',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.333751] env[65359]: INFO networking_nsxv3.common.synchronization [req-cd3009b1-4329-46ad-8d1b-fae166c4ede4 req-9435553e-4b31-4a54-9a91-ab369ce9135d tempest-ServerRescueTestJSON-579547403 tempest-ServerRescueTestJSON-579547403-project-member] Enqueued Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_members [ 1092.335798] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_members [ 1092.336285] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.336670] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.336765] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.337145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.337368] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.337527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.337610] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.337839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.337962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.339186] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.788918] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99cd336f-c85c-4bce-abf8-1731eda3f403 [ 1092.788918] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.788918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.788918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.789466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.789466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.789466] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99cd336f-c85c-4bce-abf8-1731eda3f403 already deleted. [ 1092.789466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99cd336f-c85c-4bce-abf8-1731eda3f403" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.844018] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.901030] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-649 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.901240] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-649" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.901534] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-649" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.901949] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-649" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.902251] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.902432] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.902550] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.902874] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.903271] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.903558] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.903711] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.903861] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.904110] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.904271] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.904404] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.904586] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.955887] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.956112] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.051 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1092.956261] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.956445] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-649" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.956810] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-6105da9e-f5b2-4252-8f1d-d036c53d45c2 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.956998] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-6105da9e-f5b2-4252-8f1d-d036c53d45c2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.957190] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-6105da9e-f5b2-4252-8f1d-d036c53d45c2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.957557] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-6105da9e-f5b2-4252-8f1d-d036c53d45c2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.957700] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6105da9e-f5b2-4252-8f1d-d036c53d45c2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.347023] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.461027] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.461343] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.461513] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.461835] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.462033] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.462239] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 6105da9e-f5b2-4252-8f1d-d036c53d45c2 not found, creating... [ 1093.462534] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.462720] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.462840] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.463113] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.463267] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.463667] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.463860] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.464370] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.464685] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.464984] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.465292] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 6105da9e-f5b2-4252-8f1d-d036c53d45c2 is going to be created. [ 1093.490246] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.490714] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.490714] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.490883] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.491169] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.491443] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-6105da9e-f5b2-4252-8f1d-d036c53d45c2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.502050] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13736951-03c6-4d53-ad2b-da3bf377face in Status: SUCCESS [ 1093.502219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.849923] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.850320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.850320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.850389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.850484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.850607] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07f94052-66b8-4ea9-9b43-7b740cc698df is going to be updated. [ 1093.885649] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.885821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.885860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.886097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.886265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.900213] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07f94052-66b8-4ea9-9b43-7b740cc698df in Status: IN_PROGRESS for 2s [ 1094.060271] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4589a5a7-4543-448d-9e0a-cd5d1c274131 in Status: SUCCESS [ 1094.060271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4589a5a7-4543-448d-9e0a-cd5d1c274131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.258077] env[65359]: INFO networking_nsxv3.common.synchronization [req-cd3009b1-4329-46ad-8d1b-fae166c4ede4 req-f5947762-942c-4806-a62e-0a8e1ae55eca service nova] Enqueued Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_rules [ 1094.258320] env[65359]: INFO networking_nsxv3.common.synchronization [req-cd3009b1-4329-46ad-8d1b-fae166c4ede4 req-f5947762-942c-4806-a62e-0a8e1ae55eca service nova] Enqueued Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_members [ 1094.258477] env[65359]: INFO networking_nsxv3.common.synchronization [req-cd3009b1-4329-46ad-8d1b-fae166c4ede4 req-f5947762-942c-4806-a62e-0a8e1ae55eca service nova] Enqueued Resource ID: 6105da9e-f5b2-4252-8f1d-d036c53d45c2 with Priority: HIGHEST for action port [ 1094.259011] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_rules [ 1094.259318] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_members [ 1094.259481] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6105da9e-f5b2-4252-8f1d-d036c53d45c2 with Priority: HIGHEST for action port [ 1094.259776] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.259911] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.259994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.260224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.260305] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.262489] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.262489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.262713] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-6105da9e-f5b2-4252-8f1d-d036c53d45c2 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.262819] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6105da9e-f5b2-4252-8f1d-d036c53d45c2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.263197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6105da9e-f5b2-4252-8f1d-d036c53d45c2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.263197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6105da9e-f5b2-4252-8f1d-d036c53d45c2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.263197] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6105da9e-f5b2-4252-8f1d-d036c53d45c2',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.749784] env[65359]: INFO networking_nsxv3.common.synchronization [None req-1dd66c9c-4d76-4b4c-a15d-c60d215d6e9e None None] Enqueued Resource ID: d09ccd3b-0d38-4253-8a72-bb75bc91bd7c with Priority: HIGHEST for action port [ 1094.751073] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d09ccd3b-0d38-4253-8a72-bb75bc91bd7c with Priority: HIGHEST for action port [ 1094.751073] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-d09ccd3b-0d38-4253-8a72-bb75bc91bd7c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.751073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d09ccd3b-0d38-4253-8a72-bb75bc91bd7c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.751073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d09ccd3b-0d38-4253-8a72-bb75bc91bd7c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.751298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d09ccd3b-0d38-4253-8a72-bb75bc91bd7c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.751362] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d09ccd3b-0d38-4253-8a72-bb75bc91bd7c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.765581] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.765760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.765884] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6105da9e-f5b2-4252-8f1d-d036c53d45c2 with status ACTIVE [ 1094.766073] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.766240] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.766297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.766477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.766567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.766737] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.766831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.766892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.767053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.767133] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.767320] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.767541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.767541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.767726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.767726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.767811] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6105da9e-f5b2-4252-8f1d-d036c53d45c2 is going to be updated. [ 1094.813088] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.813304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.813304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.813530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.813686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.813859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6105da9e-f5b2-4252-8f1d-d036c53d45c2" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.863480] env[65359]: INFO networking_nsxv3.common.synchronization [req-af0091af-835b-4635-954d-c6dc6ae295a1 req-eba3ddef-2467-465c-bd36-6e06dae50706 tempest-ServersTestJSON-1929866617 tempest-ServersTestJSON-1929866617-project-member] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1094.863871] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1094.865361] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.865567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.865682] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.865978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.866238] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.866370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.866427] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.866599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.866686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.866778] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.256189] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d09ccd3b-0d38-4253-8a72-bb75bc91bd7c [ 1095.256439] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.256695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.256832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.257161] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.257274] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.257392] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d09ccd3b-0d38-4253-8a72-bb75bc91bd7c already deleted. [ 1095.257509] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d09ccd3b-0d38-4253-8a72-bb75bc91bd7c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.296915] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.296915] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.296915] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.297375] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.298729] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.298987] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.299072] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.299406] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.299507] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.299768] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.299888] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.300075] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.300279] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.300500] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.300708] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.300969] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.325359] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.326919] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.326919] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.326919] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.326919] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-60460937-cf13-4c3c-a1b0-854af5b4ab69 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.326919] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-60460937-cf13-4c3c-a1b0-854af5b4ab69" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.327229] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-60460937-cf13-4c3c-a1b0-854af5b4ab69" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.327681] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-60460937-cf13-4c3c-a1b0-854af5b4ab69" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.327990] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60460937-cf13-4c3c-a1b0-854af5b4ab69',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.371043] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.830422] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.830968] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.831171] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.831591] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.831753] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.832127] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 60460937-cf13-4c3c-a1b0-854af5b4ab69 not found, creating... [ 1095.832467] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.832616] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.832761] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.833021] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.833165] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.833471] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.833642] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.833759] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.834014] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.834164] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.834316] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 60460937-cf13-4c3c-a1b0-854af5b4ab69 is going to be created. [ 1095.856527] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.856684] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.856815] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.857083] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.857311] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.857685] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-60460937-cf13-4c3c-a1b0-854af5b4ab69" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.872561] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.910732] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07f94052-66b8-4ea9-9b43-7b740cc698df in Status: SUCCESS [ 1095.911009] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.911227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.911446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.911630] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.911789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.911852] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.912068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.912157] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.912257] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.377205] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.377447] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.377447] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.377650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.377781] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.377836] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 1096.414261] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.414430] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.414485] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.414814] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.414855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.415989] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.428482] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 1096.625764] env[65359]: INFO networking_nsxv3.common.synchronization [req-af0091af-835b-4635-954d-c6dc6ae295a1 req-3f5f3d17-c708-4cc6-9c59-8ad4be9b7f24 service nova] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_rules [ 1096.625961] env[65359]: INFO networking_nsxv3.common.synchronization [req-af0091af-835b-4635-954d-c6dc6ae295a1 req-3f5f3d17-c708-4cc6-9c59-8ad4be9b7f24 service nova] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1096.626113] env[65359]: INFO networking_nsxv3.common.synchronization [req-af0091af-835b-4635-954d-c6dc6ae295a1 req-3f5f3d17-c708-4cc6-9c59-8ad4be9b7f24 service nova] Enqueued Resource ID: 60460937-cf13-4c3c-a1b0-854af5b4ab69 with Priority: HIGHEST for action port [ 1096.626653] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_rules [ 1096.626789] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1096.626888] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60460937-cf13-4c3c-a1b0-854af5b4ab69 with Priority: HIGHEST for action port [ 1096.630026] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.630802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.631109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.631228] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.631305] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.632901] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.633309] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.633309] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-60460937-cf13-4c3c-a1b0-854af5b4ab69 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.633410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60460937-cf13-4c3c-a1b0-854af5b4ab69" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.633441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60460937-cf13-4c3c-a1b0-854af5b4ab69" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.633624] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60460937-cf13-4c3c-a1b0-854af5b4ab69" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.634771] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60460937-cf13-4c3c-a1b0-854af5b4ab69',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.906036] env[65359]: INFO networking_nsxv3.common.synchronization [req-a30bc58e-972f-47ab-bd3a-3d82de4c0986 req-2e2ce35f-598d-4ba8-9827-15939c1ae35e tempest-ServerDiskConfigTestJSON-2085995032 tempest-ServerDiskConfigTestJSON-2085995032-project-member] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 1096.906614] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGHEST for action security_group_members [ 1096.906979] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.907147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.907236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.907794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.907794] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.907794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.907794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.908036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.908068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.908162] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.920945] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.136443] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.138179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.138500] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60460937-cf13-4c3c-a1b0-854af5b4ab69 with status ACTIVE [ 1097.138726] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.138837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.138904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.139459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.139459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.139459] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.139645] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.139645] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.139710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.139763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.140210] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.140210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.140210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.140210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.140415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.140415] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60460937-cf13-4c3c-a1b0-854af5b4ab69 is going to be updated. [ 1097.170302] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.170302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.170302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.170302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.170302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.170302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60460937-cf13-4c3c-a1b0-854af5b4ab69" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.411191] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.412489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.412489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.412489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.412489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.417317] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.417969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.417969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.418072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.418237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.418373] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be updated. [ 1097.421640] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.421640] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.421640] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.421640] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.421640] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.421640] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07f94052-66b8-4ea9-9b43-7b740cc698df is going to be updated. [ 1097.464491] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.464933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.465183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.465833] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.465833] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.469666] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.469666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.469918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.473702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.474109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.486103] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: IN_PROGRESS for 2s [ 1097.491041] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07f94052-66b8-4ea9-9b43-7b740cc698df in Status: IN_PROGRESS for 2s [ 1097.868081] env[65359]: INFO networking_nsxv3.common.synchronization [req-e7a67b45-15e1-421e-83d4-db379c949760 req-b4fc0978-b9d1-4588-9f23-86143438365a tempest-ServerActionsTestOtherB-968321773 tempest-ServerActionsTestOtherB-968321773-project-member] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1097.868869] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1097.872016] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.872196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.872270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.872519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.872723] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.872825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.872905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.873062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.873151] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.873248] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.278999] env[65359]: INFO networking_nsxv3.common.synchronization [req-1b530247-f9c9-4030-b3d2-977433ee4f55 req-33de5290-8a0f-455e-b495-28f496ee894e tempest-DeleteServersTestJSON-2065668722 tempest-DeleteServersTestJSON-2065668722-project-member] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1098.279940] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1098.280223] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.280464] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.280591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.280830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.281035] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.281176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.281266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.281854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.281854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.281854] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.376423] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.376638] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.376967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.377072] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.400858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.401251] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.401387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.402675] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.403413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.403413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.403413] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 is going to be updated. [ 1098.437519] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.437688] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.437759] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.437975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.438133] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.442178] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 1098.442413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.442591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.442829] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.443071] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.443201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.443268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.443450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.443541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.443645] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.447815] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: IN_PROGRESS for 2s [ 1098.785637] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.786022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.786022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.786189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.786261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.786455] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.786555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.786618] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.786772] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.786838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.786927] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 1098.844049] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.844212] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.844283] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.844545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.844658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.858630] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 1098.946312] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.975422] env[65359]: INFO networking_nsxv3.common.synchronization [req-57565f77-89e2-4a32-946f-1e7eb2bede34 req-d4998be3-bfd7-44ff-b566-7fdee4e32de0 tempest-AttachVolumeTestJSON-1956829346 tempest-AttachVolumeTestJSON-1956829346-project-member] Enqueued Resource ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 with Priority: HIGHEST for action security_group_members [ 1098.976209] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 with Priority: HIGHEST for action security_group_members [ 1098.977335] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.977480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.977585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.977896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.978076] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.978185] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.978248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.978408] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.978482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.978595] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e88dc066-ae5f-45ff-a0ca-c16383ec5af9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.449535] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.481316] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.481616] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.481616] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.482170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.498694] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4dca704-f8c2-494f-bbf6-802020c49b4b in Status: SUCCESS [ 1099.498824] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b deletion is rescheduled due to dependency. [ 1099.498976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.500393] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07f94052-66b8-4ea9-9b43-7b740cc698df in Status: SUCCESS [ 1099.500587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.500737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.500949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.501152] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.501283] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.501392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.501550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.501635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.501723] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.501816] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.506959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.507206] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.507313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.507388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.507572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.507654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.507746] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 is going to be updated. [ 1099.554667] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.554849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.554979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.555159] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.555305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.567373] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 in Status: IN_PROGRESS for 2s [ 1099.955169] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.955378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.955453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.955668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.955774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.955872] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 1099.986626] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.986793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.986867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.987128] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.987319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.997545] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 1100.004350] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.004542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.004616] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.004800] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.005036] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.005614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.005691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.005871] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.005966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.006078] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.006254] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.006349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.006414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.006579] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.006725] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.006832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.006893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.007054] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.007141] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.007226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.007319] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.459852] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: SUCCESS [ 1100.460233] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 deletion is rescheduled due to dependency. [ 1100.460233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.512401] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07f94052-66b8-4ea9-9b43-7b740cc698df: rpc.has_security_group_logging(os_id): False [ 1100.531862] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.532096] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.532196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.532468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.557110] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.557401] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.557545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.557628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.557898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.558017] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.558384] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.558533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.558610] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.558842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.558946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.560456] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.560639] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.560762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.561856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.561979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.562104] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07f94052-66b8-4ea9-9b43-7b740cc698df is going to be updated. [ 1100.634220] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.634444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.634499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.634758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.634898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.652774] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07f94052-66b8-4ea9-9b43-7b740cc698df in Status: IN_PROGRESS for 2s [ 1100.871451] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 1100.871700] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb deletion is rescheduled due to dependency. [ 1100.871970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.580979] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 in Status: SUCCESS [ 1101.581282] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e88dc066-ae5f-45ff-a0ca-c16383ec5af9 deletion is rescheduled due to dependency. [ 1101.581282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e88dc066-ae5f-45ff-a0ca-c16383ec5af9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.008034] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 1102.008278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.008456] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.008680] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.009008] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.009163] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.009236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.009408] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.009493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.009582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.009676] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.512494] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.512704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.512704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.512959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.513177] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.513280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.513356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.514109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.514109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.514109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.514109] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.514109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.514109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.514422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.514422] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.514422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.514634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.514751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.514810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.514873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.515013] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.571891] env[65359]: INFO networking_nsxv3.common.synchronization [req-c0613ef7-bd50-4f42-9683-0d82200c201f req-3ef73ea7-3135-4318-9e69-b005197be56b tempest-ServerRescueNegativeTestJSON-174363340 tempest-ServerRescueNegativeTestJSON-174363340-project-member] Enqueued Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_members [ 1102.572657] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGHEST for action security_group_members [ 1102.575125] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.575125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.575125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.575125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.575125] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.575125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.575125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.575125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.575125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.575125] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.671192] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07f94052-66b8-4ea9-9b43-7b740cc698df in Status: SUCCESS [ 1102.671525] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.018549] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5: rpc.has_security_group_logging(os_id): False [ 1103.039939] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.040118] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.040196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.040469] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.066496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.066794] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.066925] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.066995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.067204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.067291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.067483] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.067588] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.067649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.067793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.067883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.068059] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.068159] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.068218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.068360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.068428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.068518] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 1103.076377] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.076580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.076626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.076809] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.104328] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.104622] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.104762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.104827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.105046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.105167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.105517] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4a73e88-8afb-4866-a66b-2583f493db5e is going to be updated. [ 1103.141504] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.141687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.141774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.141966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.142160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.153623] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4a73e88-8afb-4866-a66b-2583f493db5e in Status: IN_PROGRESS for 2s [ 1103.167935] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.168146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.168220] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.168395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.168576] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.213457] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 1105.170231] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4a73e88-8afb-4866-a66b-2583f493db5e in Status: SUCCESS [ 1105.170231] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4a73e88-8afb-4866-a66b-2583f493db5e deletion is rescheduled due to dependency. [ 1105.170231] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.236430] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 1105.236732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.105606] env[65359]: INFO networking_nsxv3.common.synchronization [req-2fb7007e-e98c-46fa-bee4-ba79fcd2061b req-70cbcc5d-3f8c-4adc-9106-6d1c0679fdcf tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_members [ 1106.106461] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_members [ 1106.106767] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.106929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.106995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.107432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.107432] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.107577] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.107614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.107855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.107973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.108088] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.555716] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.556027] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.556070] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.556349] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.556630] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.556837] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.556912] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.557193] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.557383] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.557602] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.557722] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.557860] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.557975] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.558143] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.558231] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.558366] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.580827] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.581014] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1106.581170] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.581352] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.581667] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-432b271d-d97e-425e-a43d-3fb784c9d516 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.581844] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-432b271d-d97e-425e-a43d-3fb784c9d516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.581962] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-432b271d-d97e-425e-a43d-3fb784c9d516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.582322] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-432b271d-d97e-425e-a43d-3fb784c9d516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.582469] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('432b271d-d97e-425e-a43d-3fb784c9d516',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.610776] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.085129] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.085969] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.085969] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.086163] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.086312] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.086504] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 432b271d-d97e-425e-a43d-3fb784c9d516 not found, creating... [ 1107.086854] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.087082] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.087244] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.087550] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.087696] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.087997] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.088173] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.088291] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.088504] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.088638] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.088773] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 432b271d-d97e-425e-a43d-3fb784c9d516 is going to be created. [ 1107.111719] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.112663] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.112663] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.112663] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.112869] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.113122] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-432b271d-d97e-425e-a43d-3fb784c9d516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.114688] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.617096] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.617560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.617560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.617735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.617882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.618055] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 is going to be updated. [ 1107.691734] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.691978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.692044] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.692366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.692552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.708199] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: IN_PROGRESS for 2s [ 1107.941620] env[65359]: INFO networking_nsxv3.common.synchronization [req-2fb7007e-e98c-46fa-bee4-ba79fcd2061b req-df10bc43-6582-4d56-a682-231ef7c918d2 service nova] Enqueued Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_rules [ 1107.941929] env[65359]: INFO networking_nsxv3.common.synchronization [req-2fb7007e-e98c-46fa-bee4-ba79fcd2061b req-df10bc43-6582-4d56-a682-231ef7c918d2 service nova] Enqueued Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_members [ 1107.942478] env[65359]: INFO networking_nsxv3.common.synchronization [req-2fb7007e-e98c-46fa-bee4-ba79fcd2061b req-df10bc43-6582-4d56-a682-231ef7c918d2 service nova] Enqueued Resource ID: 432b271d-d97e-425e-a43d-3fb784c9d516 with Priority: HIGHEST for action port [ 1107.943965] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_rules [ 1107.943965] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_members [ 1107.943965] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 432b271d-d97e-425e-a43d-3fb784c9d516 with Priority: HIGHEST for action port [ 1107.944408] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.944666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.944771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.945066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.945188] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.951116] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.951347] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.951665] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-432b271d-d97e-425e-a43d-3fb784c9d516 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.952449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-432b271d-d97e-425e-a43d-3fb784c9d516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.952449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-432b271d-d97e-425e-a43d-3fb784c9d516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.952449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-432b271d-d97e-425e-a43d-3fb784c9d516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.952449] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('432b271d-d97e-425e-a43d-3fb784c9d516',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.454974] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.455320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.455859] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 432b271d-d97e-425e-a43d-3fb784c9d516 with status ACTIVE [ 1108.455859] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.456126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.456126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.456202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.456321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.456549] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.456700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.456764] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.457041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.457041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.457225] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.457328] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.457422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.457630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.457718] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.457815] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 432b271d-d97e-425e-a43d-3fb784c9d516 is going to be updated. [ 1108.470816] env[65359]: INFO networking_nsxv3.common.synchronization [None req-c90e7308-e0d9-41ce-9b88-1a9567a06828 None None] Enqueued Resource ID: a59d6111-e432-4747-bc20-7d2969ea6fa3 with Priority: HIGHEST for action port [ 1108.471342] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59d6111-e432-4747-bc20-7d2969ea6fa3 with Priority: HIGHEST for action port [ 1108.471657] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-a59d6111-e432-4747-bc20-7d2969ea6fa3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.471798] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a59d6111-e432-4747-bc20-7d2969ea6fa3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.471848] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a59d6111-e432-4747-bc20-7d2969ea6fa3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.472705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a59d6111-e432-4747-bc20-7d2969ea6fa3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.472705] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a59d6111-e432-4747-bc20-7d2969ea6fa3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.479472] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.479634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.479673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.479895] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.480025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.480351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-432b271d-d97e-425e-a43d-3fb784c9d516" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.648949] env[65359]: INFO networking_nsxv3.common.synchronization [req-67eca5e5-4f85-4031-b947-e586488900e5 req-c828237c-fb2c-403b-9e4a-71388694eb86 tempest-AttachInterfacesV270Test-1250524836 tempest-AttachInterfacesV270Test-1250524836-project-member] Enqueued Resource ID: 588bed60-cf0f-4c53-9608-288d006dd2be with Priority: HIGHEST for action security_group_members [ 1108.648949] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588bed60-cf0f-4c53-9608-288d006dd2be with Priority: HIGHEST for action security_group_members [ 1108.649299] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-588bed60-cf0f-4c53-9608-288d006dd2be taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.649422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.649490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.649742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.649904] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.650011] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.650472] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.650647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.650739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.650838] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('588bed60-cf0f-4c53-9608-288d006dd2be',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.974849] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a59d6111-e432-4747-bc20-7d2969ea6fa3 [ 1108.976496] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.976496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.976496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.976496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.976496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.976496] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a59d6111-e432-4747-bc20-7d2969ea6fa3 already deleted. [ 1108.976496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a59d6111-e432-4747-bc20-7d2969ea6fa3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.137167] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-100 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.137386] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-100" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.137466] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-100" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.137819] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-100" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.138127] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.138291] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.138412] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.138660] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.138809] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.139040] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.139240] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.139368] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.139489] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.139605] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.139727] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.139855] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.153600] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.154233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.154329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.155062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.155062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.155062] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.155265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.155265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.155459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.155613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.155769] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 588bed60-cf0f-4c53-9608-288d006dd2be already deleted. [ 1109.155911] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.161467] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.161467] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1109.161467] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.161677] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-100" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.162944] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-97538273-6143-4660-a7f6-d2dc44587e0c taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.162944] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-97538273-6143-4660-a7f6-d2dc44587e0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.162944] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-97538273-6143-4660-a7f6-d2dc44587e0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.162944] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-97538273-6143-4660-a7f6-d2dc44587e0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.162944] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97538273-6143-4660-a7f6-d2dc44587e0c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.183954] env[65359]: INFO networking_nsxv3.common.synchronization [req-ff0086ab-a5e2-4933-8c7e-adf26aa340f6 req-25423878-cb1c-44a0-a386-12618a028426 tempest-ServersTestJSON-1929866617 tempest-ServersTestJSON-1929866617-project-member] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1109.184814] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1109.185623] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.185826] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.185910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.186193] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.186395] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.186557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.186626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.190020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.190020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.190020] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.665623] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.665942] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.666091] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.666439] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.666703] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.667840] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 97538273-6143-4660-a7f6-d2dc44587e0c not found, creating... [ 1109.667840] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.667840] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.667840] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.667840] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.668071] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.668375] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.668563] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.668724] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.668989] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.669188] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.669530] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 97538273-6143-4660-a7f6-d2dc44587e0c is going to be created. [ 1109.690715] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.697271] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.697271] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.697271] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.697271] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.697469] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.697700] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-97538273-6143-4660-a7f6-d2dc44587e0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.722556] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: IN_PROGRESS for 4s [ 1110.201789] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.475484] env[65359]: INFO networking_nsxv3.common.synchronization [req-67eca5e5-4f85-4031-b947-e586488900e5 req-8983d5f6-2282-48b0-a002-4357e7e429ed service nova] Enqueued Resource ID: 588bed60-cf0f-4c53-9608-288d006dd2be with Priority: HIGHEST for action security_group_rules [ 1110.475672] env[65359]: INFO networking_nsxv3.common.synchronization [req-67eca5e5-4f85-4031-b947-e586488900e5 req-8983d5f6-2282-48b0-a002-4357e7e429ed service nova] Enqueued Resource ID: 588bed60-cf0f-4c53-9608-288d006dd2be with Priority: HIGHEST for action security_group_members [ 1110.475812] env[65359]: INFO networking_nsxv3.common.synchronization [req-67eca5e5-4f85-4031-b947-e586488900e5 req-8983d5f6-2282-48b0-a002-4357e7e429ed service nova] Enqueued Resource ID: 97538273-6143-4660-a7f6-d2dc44587e0c with Priority: HIGHEST for action port [ 1110.476381] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588bed60-cf0f-4c53-9608-288d006dd2be with Priority: HIGHEST for action security_group_rules [ 1110.476573] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588bed60-cf0f-4c53-9608-288d006dd2be with Priority: HIGHEST for action security_group_members [ 1110.476671] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97538273-6143-4660-a7f6-d2dc44587e0c with Priority: HIGHEST for action port [ 1110.477252] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-588bed60-cf0f-4c53-9608-288d006dd2be taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.477252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.477252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.477614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.477614] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('588bed60-cf0f-4c53-9608-288d006dd2be',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.478563] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-588bed60-cf0f-4c53-9608-288d006dd2be taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.478673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.478801] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.478937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.479242] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.479242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.479242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.479473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.479473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.479629] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('588bed60-cf0f-4c53-9608-288d006dd2be',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.480692] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-97538273-6143-4660-a7f6-d2dc44587e0c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.480820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97538273-6143-4660-a7f6-d2dc44587e0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.480875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97538273-6143-4660-a7f6-d2dc44587e0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.484198] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97538273-6143-4660-a7f6-d2dc44587e0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.484395] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97538273-6143-4660-a7f6-d2dc44587e0c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.703090] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.703952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.704087] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.704326] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.704429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.704537] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 1110.734929] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.735124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.735195] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.735414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.735567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.746783] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 1110.926270] env[65359]: INFO networking_nsxv3.common.synchronization [None req-c8c6736e-b80a-4303-b37a-1e092c818fe4 None None] Enqueued Resource ID: 1282215e-9e54-4ea6-bcfb-375022023cef with Priority: HIGHEST for action port [ 1110.926896] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1282215e-9e54-4ea6-bcfb-375022023cef with Priority: HIGHEST for action port [ 1110.927224] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-1282215e-9e54-4ea6-bcfb-375022023cef taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.927353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1282215e-9e54-4ea6-bcfb-375022023cef" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.927421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1282215e-9e54-4ea6-bcfb-375022023cef" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.927678] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1282215e-9e54-4ea6-bcfb-375022023cef" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.927790] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1282215e-9e54-4ea6-bcfb-375022023cef',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.986224] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-588bed60-cf0f-4c53-9608-288d006dd2be taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.986432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.986767] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('588bed60-cf0f-4c53-9608-288d006dd2be',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.988179] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97538273-6143-4660-a7f6-d2dc44587e0c with status ACTIVE [ 1110.988179] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.988179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.988179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.988399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.988399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.989137] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.989137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.989455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.989455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.989455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.989653] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.989838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.989838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.989961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.990034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.990100] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97538273-6143-4660-a7f6-d2dc44587e0c is going to be updated. [ 1111.015333] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.016859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.016859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.016859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.016859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.016859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97538273-6143-4660-a7f6-d2dc44587e0c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.431764] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1282215e-9e54-4ea6-bcfb-375022023cef [ 1111.432054] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.432212] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.432308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.432489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.432598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.432702] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1282215e-9e54-4ea6-bcfb-375022023cef already deleted. [ 1111.432745] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1282215e-9e54-4ea6-bcfb-375022023cef" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.491986] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('588bed60-cf0f-4c53-9608-288d006dd2be',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.733692] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: SUCCESS [ 1111.734019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.734179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.734436] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.734654] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.734824] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.734904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.735119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.735217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.735323] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.995653] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.995653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.995653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.995896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.995896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.995896] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 588bed60-cf0f-4c53-9608-288d006dd2be is going to be created. [ 1112.024396] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.024578] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.024643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.024823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.024986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.040506] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 588bed60-cf0f-4c53-9608-288d006dd2be in Status: UNINITIALIZED for 2s [ 1112.238986] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.741748] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.760115] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 1112.760343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.806376] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-124 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.806376] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.806376] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.806376] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.806376] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.807485] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.807485] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.807485] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.807485] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.807485] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.807485] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.807485] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.807658] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.807685] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.807780] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.807901] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.830707] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.830890] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1112.831421] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.831546] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-124" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.832078] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-f84a4b7b-910c-425c-a5c5-718a49fa99e7 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.832242] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.832397] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.832745] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.832745] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f84a4b7b-910c-425c-a5c5-718a49fa99e7',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.245862] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.246144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.246221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.246401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.246497] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.246671] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 is going to be updated. [ 1113.284090] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.284090] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.284090] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.284090] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.284090] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.296053] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: IN_PROGRESS for 2s [ 1113.339035] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.339035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.339035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.339035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.339035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.339035] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.339035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.339035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.339035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.339035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.339678] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.339678] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.339678] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.339678] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.339953] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.340253] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: f84a4b7b-910c-425c-a5c5-718a49fa99e7 is going to be updated. [ 1113.365502] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.365502] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.365502] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.365502] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.365831] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.366033] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.913036] env[65359]: INFO networking_nsxv3.common.synchronization [req-a2a57777-4dc6-440f-ae37-d720fe9b1c62 req-687392cb-78bf-4296-aca5-aa38b6e4267b tempest-ImagesOneServerTestJSON-1241293410 tempest-ImagesOneServerTestJSON-1241293410-project-member] Enqueued Resource ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 with Priority: HIGHEST for action security_group_members [ 1113.914424] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 with Priority: HIGHEST for action security_group_members [ 1113.914424] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.914582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.914665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.914864] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.915188] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.915372] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.915486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.915623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.915716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.915817] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bf93232-d104-4fc5-a8d6-ea22dbf41b58',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.053522] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 588bed60-cf0f-4c53-9608-288d006dd2be in Status: SUCCESS [ 1114.053806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.054468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.054702] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.054913] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.055053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.055138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.055310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.055401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.055487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.055582] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('588bed60-cf0f-4c53-9608-288d006dd2be',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.105565] env[65359]: INFO networking_nsxv3.common.synchronization [req-4ebf49f4-6f8b-49d5-aba4-2ab46fdc09bf req-aac1e1c4-6e2b-41e0-8755-5c1494fd1019 service nova] Enqueued Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_rules [ 1114.106026] env[65359]: INFO networking_nsxv3.common.synchronization [req-4ebf49f4-6f8b-49d5-aba4-2ab46fdc09bf req-aac1e1c4-6e2b-41e0-8755-5c1494fd1019 service nova] Enqueued Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_members [ 1114.106026] env[65359]: INFO networking_nsxv3.common.synchronization [req-4ebf49f4-6f8b-49d5-aba4-2ab46fdc09bf req-aac1e1c4-6e2b-41e0-8755-5c1494fd1019 service nova] Enqueued Resource ID: f84a4b7b-910c-425c-a5c5-718a49fa99e7 with Priority: HIGHEST for action port [ 1114.107574] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_rules [ 1114.107574] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_members [ 1114.107708] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f84a4b7b-910c-425c-a5c5-718a49fa99e7 with Priority: HIGHEST for action port [ 1114.107940] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db3579e6-ea77-4102-ba19-0829034e0bac taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.108366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.108366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.108501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.108501] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.111297] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-db3579e6-ea77-4102-ba19-0829034e0bac taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.111297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.111297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.111297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.111297] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.111297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.111297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.111297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.111297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.111297] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.111769] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-f84a4b7b-910c-425c-a5c5-718a49fa99e7 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.111769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.111870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.112257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.112257] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f84a4b7b-910c-425c-a5c5-718a49fa99e7',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.421093] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.421093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.421093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.421093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.447452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.447602] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.447755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.447755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.448084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.448084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.448200] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 is going to be updated. [ 1114.484474] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.484681] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.484739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.484960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.485249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.497670] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 in Status: IN_PROGRESS for 2s [ 1114.558487] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-588bed60-cf0f-4c53-9608-288d006dd2be taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.558683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.558823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.559039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.559202] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.559307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.559379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.559590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.559695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.559764] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.560046] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-588bed60-cf0f-4c53-9608-288d006dd2be taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.560179] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.560219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.560768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.560768] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.560768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.560768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.560970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.560970] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.561108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.561169] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('588bed60-cf0f-4c53-9608-288d006dd2be',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.614566] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-db3579e6-ea77-4102-ba19-0829034e0bac taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.614882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.614963] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.615963] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f84a4b7b-910c-425c-a5c5-718a49fa99e7 with status ACTIVE [ 1114.616200] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.616320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.616401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.616618] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.616711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.616892] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.616987] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.617826] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.617918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.617974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.618328] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.618439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.618601] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.618647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.618824] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.618824] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f84a4b7b-910c-425c-a5c5-718a49fa99e7 is going to be updated. [ 1114.642979] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.642979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.642979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.643245] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.643410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.643586] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f84a4b7b-910c-425c-a5c5-718a49fa99e7" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.063771] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 588bed60-cf0f-4c53-9608-288d006dd2be: rpc.has_security_group_logging(os_id): False [ 1115.085661] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.085954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.085954] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.086260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.086419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.086684] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.086823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.086951] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.087137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.087244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.087496] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.087654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.087713] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.087887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.087988] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.088380] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.088497] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.088585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.088776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.088884] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.089056] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 588bed60-cf0f-4c53-9608-288d006dd2be is going to be created. [ 1115.121266] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.155128] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.155360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.155512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.155777] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.156495] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.169595] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 588bed60-cf0f-4c53-9608-288d006dd2be in Status: IN_PROGRESS for 2s [ 1115.307459] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: SUCCESS [ 1115.307459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.307459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.307459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.307627] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.307627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.307710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.307811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.308025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.308025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.308109] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.624509] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.624704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.624834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.625089] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.625250] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.625447] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db3579e6-ea77-4102-ba19-0829034e0bac is going to be updated. [ 1115.659453] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.660097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.660097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.660097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.660287] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.671389] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db3579e6-ea77-4102-ba19-0829034e0bac in Status: IN_PROGRESS for 2s [ 1115.810914] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.312210] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6599e228-9d5e-4d59-9a87-ffa7ce620eb9: rpc.has_security_group_logging(os_id): False [ 1116.336024] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.336024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.336024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.336024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.336024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.336024] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.336024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.336024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.336024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.336024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.336024] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 is going to be updated. [ 1116.406714] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.406880] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.407051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.407264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.407666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.423666] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: IN_PROGRESS for 2s [ 1116.507733] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 in Status: SUCCESS [ 1116.507733] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 deletion is rescheduled due to dependency. [ 1116.507918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.183153] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 588bed60-cf0f-4c53-9608-288d006dd2be in Status: SUCCESS [ 1117.183153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.270687] env[65359]: INFO networking_nsxv3.common.synchronization [None req-35dc0a67-240e-47fe-b8a5-d2debe26c244 tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 1117.271117] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 1117.271422] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.271544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.271608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.271822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.271976] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.272115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.274158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.274158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.274158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.274158] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.683682] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db3579e6-ea77-4102-ba19-0829034e0bac in Status: SUCCESS [ 1117.683682] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.683947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.684054] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.684381] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.684479] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.684544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.684737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.684868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.684974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.685849] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.776814] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.776814] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.777012] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.777788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.778187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.780122] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.780122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.780122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.780122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.780122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.780122] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be deleted. [ 1117.824336] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.824605] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.824672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.825297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.825297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.825297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.189372] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.449280] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: SUCCESS [ 1118.449280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.694468] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db3579e6-ea77-4102-ba19-0829034e0bac: rpc.has_security_group_logging(os_id): False [ 1118.714541] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.714541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.714541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.715881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.737919] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.738428] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.738630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.738751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.739111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.739254] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.739409] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db3579e6-ea77-4102-ba19-0829034e0bac is going to be updated. [ 1118.823129] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.823129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.823129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.823129] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.823575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.843848] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db3579e6-ea77-4102-ba19-0829034e0bac in Status: IN_PROGRESS for 2s [ 1120.603437] env[65359]: INFO networking_nsxv3.common.synchronization [req-2fa014a2-9ad9-4176-abae-79fb384a0e96 req-91c2488c-0a19-4503-8fba-90149efd599e tempest-ServerRescueTestJSON-579547403 tempest-ServerRescueTestJSON-579547403-project-member] Enqueued Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_members [ 1120.603762] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_members [ 1120.605491] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.605491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.605491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.605491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.605491] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.605491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.605491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.605491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.605491] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.606117] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.864077] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db3579e6-ea77-4102-ba19-0829034e0bac in Status: SUCCESS [ 1120.864516] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.032691] env[65359]: INFO networking_nsxv3.common.synchronization [None req-e51471e2-96ba-43bd-a17e-bcecea7a9aeb None None] Enqueued Resource ID: 67c832ce-da1a-40d7-b974-f94d3ea92e2a with Priority: HIGHEST for action port [ 1121.033406] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c832ce-da1a-40d7-b974-f94d3ea92e2a with Priority: HIGHEST for action port [ 1121.033786] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-67c832ce-da1a-40d7-b974-f94d3ea92e2a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.033947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67c832ce-da1a-40d7-b974-f94d3ea92e2a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.034078] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67c832ce-da1a-40d7-b974-f94d3ea92e2a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.034271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67c832ce-da1a-40d7-b974-f94d3ea92e2a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.034353] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67c832ce-da1a-40d7-b974-f94d3ea92e2a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.111686] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.537467] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67c832ce-da1a-40d7-b974-f94d3ea92e2a [ 1121.538272] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.538421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.539033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.539033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.539033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.539233] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67c832ce-da1a-40d7-b974-f94d3ea92e2a already deleted. [ 1121.539335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67c832ce-da1a-40d7-b974-f94d3ea92e2a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.618433] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.121578] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.121767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.121825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.122051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.122149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.122253] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07f94052-66b8-4ea9-9b43-7b740cc698df is going to be updated. [ 1122.153932] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.154170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.154273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.154563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.154897] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.167758] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07f94052-66b8-4ea9-9b43-7b740cc698df in Status: IN_PROGRESS for 2s [ 1122.368914] env[65359]: INFO networking_nsxv3.common.synchronization [None req-4a4637e3-ae48-496d-bf9c-2d632cbf5843 tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_rules [ 1122.369434] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_rules [ 1122.369738] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.369840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.369911] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.370313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.370397] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.536476] env[65359]: INFO networking_nsxv3.common.synchronization [None req-293b30c1-67c4-4499-8ee1-8d0da1e0811a tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_rules [ 1122.537175] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_rules [ 1122.537531] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.538840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.897495] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.897790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.897790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.898883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.899234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.900226] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 already deleted. [ 1122.900332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.900500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.900693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.900769] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.278331] env[65359]: INFO networking_nsxv3.common.synchronization [None req-818d1ff3-287c-4ec5-a017-d0447aa1c0eb None None] Enqueued Resource ID: c461c2a3-1739-424e-94b7-ebbc1000abd5 with Priority: HIGHEST for action port [ 1123.278331] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c461c2a3-1739-424e-94b7-ebbc1000abd5 with Priority: HIGHEST for action port [ 1123.278331] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-c461c2a3-1739-424e-94b7-ebbc1000abd5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.278331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c461c2a3-1739-424e-94b7-ebbc1000abd5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.278331] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c461c2a3-1739-424e-94b7-ebbc1000abd5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.279786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c461c2a3-1739-424e-94b7-ebbc1000abd5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.281773] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c461c2a3-1739-424e-94b7-ebbc1000abd5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.423434] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.423926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.424521] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.425083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.425699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.425699] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 already deleted. [ 1123.425699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.785382] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c461c2a3-1739-424e-94b7-ebbc1000abd5 [ 1123.785577] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.785739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.785811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.786285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.786285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.786285] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c461c2a3-1739-424e-94b7-ebbc1000abd5 already deleted. [ 1123.786285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c461c2a3-1739-424e-94b7-ebbc1000abd5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.178688] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07f94052-66b8-4ea9-9b43-7b740cc698df in Status: SUCCESS [ 1124.179020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.377954] env[65359]: INFO networking_nsxv3.common.synchronization [req-a51f1ffb-ecd1-4d80-bcc2-6afce95650c0 req-2430c5b2-176b-48b6-868b-f87b0771e35a tempest-AttachInterfacesV270Test-1250524836 tempest-AttachInterfacesV270Test-1250524836-project-member] Enqueued Resource ID: 588bed60-cf0f-4c53-9608-288d006dd2be with Priority: HIGHEST for action security_group_members [ 1127.379823] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588bed60-cf0f-4c53-9608-288d006dd2be with Priority: HIGHEST for action security_group_members [ 1127.379823] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-588bed60-cf0f-4c53-9608-288d006dd2be taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.379823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.379823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.379823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.379823] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.379823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.379823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.379823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.379823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.379823] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('588bed60-cf0f-4c53-9608-288d006dd2be',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.885325] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.885504] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.885580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.885806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.885900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.886116] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.886220] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.886283] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.886782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.886866] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.886958] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 588bed60-cf0f-4c53-9608-288d006dd2be is going to be updated. [ 1127.915774] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.916474] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.916474] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.916474] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.916474] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.927039] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 588bed60-cf0f-4c53-9608-288d006dd2be in Status: IN_PROGRESS for 2s [ 1129.881931] env[65359]: INFO networking_nsxv3.common.synchronization [req-c0acf8fc-a1aa-464f-ad92-56e4e4f3b643 req-dca02dba-0ab6-4265-8463-f61520f06349 tempest-ServerActionsTestJSON-975876043 tempest-ServerActionsTestJSON-975876043-project-member] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 1129.882959] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 1129.882959] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.882959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.882959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.883292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.883327] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.883423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.883480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.883632] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.884319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.884319] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.925372] env[65359]: INFO networking_nsxv3.common.synchronization [req-b8c2ffb4-d51e-4264-b17d-387954736dca req-a3d9a0ed-4283-4706-96f6-1343c136847e tempest-ServerMetadataTestJSON-1795233240 tempest-ServerMetadataTestJSON-1795233240-project-member] Enqueued Resource ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c with Priority: HIGHEST for action security_group_members [ 1129.926437] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c with Priority: HIGHEST for action security_group_members [ 1129.927237] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.927426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.927538] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.927836] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.928220] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.928394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.928608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.928921] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.928921] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.929018] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.940977] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 588bed60-cf0f-4c53-9608-288d006dd2be in Status: SUCCESS [ 1129.940977] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 588bed60-cf0f-4c53-9608-288d006dd2be deletion is rescheduled due to dependency. [ 1129.940977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.284533] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.284533] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-438" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.284533] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-438" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.284533] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-438" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.284533] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.284533] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.284533] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.284956] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.284956] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.284956] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.285083] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.285159] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.285305] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.285428] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.285534] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.285665] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.304683] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.304891] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1130.305049] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.305202] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-438" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.305509] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-7f3e6ab7-cf40-443a-8f25-79bf6fcea416 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.305686] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-7f3e6ab7-cf40-443a-8f25-79bf6fcea416" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.305805] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-7f3e6ab7-cf40-443a-8f25-79bf6fcea416" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.306164] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-7f3e6ab7-cf40-443a-8f25-79bf6fcea416" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.306298] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f3e6ab7-cf40-443a-8f25-79bf6fcea416',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.385563] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.385749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.385822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.386054] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.386150] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.386339] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.386444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.386705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.386705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.386705] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.386818] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 is going to be updated. [ 1130.412364] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.412439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.412549] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.412791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.412855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.422687] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: IN_PROGRESS for 2s [ 1130.432300] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.432480] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.432555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.432955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.432955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.433494] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.433494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.433494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.433710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.433710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.433790] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c already deleted. [ 1130.433842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.808730] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.808939] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.808939] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.809227] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.809405] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.809559] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 7f3e6ab7-cf40-443a-8f25-79bf6fcea416 not found, creating... [ 1130.809912] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.810095] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.810241] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.810454] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.810589] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.810886] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.811047] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.811166] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.811377] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.811517] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.811658] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 7f3e6ab7-cf40-443a-8f25-79bf6fcea416 is going to be created. [ 1130.836120] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.836356] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.836445] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.836782] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.837026] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.837305] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-7f3e6ab7-cf40-443a-8f25-79bf6fcea416" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.603023] env[65359]: INFO networking_nsxv3.common.synchronization [req-b8c2ffb4-d51e-4264-b17d-387954736dca req-520a2059-feea-4316-ae96-8b25fbbb29fd service nova] Enqueued Resource ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c with Priority: HIGHEST for action security_group_rules [ 1131.603277] env[65359]: INFO networking_nsxv3.common.synchronization [req-b8c2ffb4-d51e-4264-b17d-387954736dca req-520a2059-feea-4316-ae96-8b25fbbb29fd service nova] Enqueued Resource ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c with Priority: HIGHEST for action security_group_members [ 1131.603389] env[65359]: INFO networking_nsxv3.common.synchronization [req-b8c2ffb4-d51e-4264-b17d-387954736dca req-520a2059-feea-4316-ae96-8b25fbbb29fd service nova] Enqueued Resource ID: 7f3e6ab7-cf40-443a-8f25-79bf6fcea416 with Priority: HIGHEST for action port [ 1131.603986] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c with Priority: HIGHEST for action security_group_rules [ 1131.604142] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c with Priority: HIGHEST for action security_group_members [ 1131.604303] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3e6ab7-cf40-443a-8f25-79bf6fcea416 with Priority: HIGHEST for action port [ 1131.604785] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.604785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.604962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.605113] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.605230] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.606530] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.606667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.607356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.607635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.607929] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.608161] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.608213] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.608633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.608633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.608800] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.611366] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f3e6ab7-cf40-443a-8f25-79bf6fcea416 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.611488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f3e6ab7-cf40-443a-8f25-79bf6fcea416" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.611529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f3e6ab7-cf40-443a-8f25-79bf6fcea416" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.611793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f3e6ab7-cf40-443a-8f25-79bf6fcea416" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.611869] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f3e6ab7-cf40-443a-8f25-79bf6fcea416',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.114642] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f3e6ab7-cf40-443a-8f25-79bf6fcea416 with status ACTIVE [ 1132.114746] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.115024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.115024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.115322] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.115322] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.115436] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.115533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.116489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.116489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.116489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.116489] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.116489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.116489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.116489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.116489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.116489] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f3e6ab7-cf40-443a-8f25-79bf6fcea416 is going to be updated. [ 1132.117856] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.117856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.117986] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.144369] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.144541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.144623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.144790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.144931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.145110] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f3e6ab7-cf40-443a-8f25-79bf6fcea416" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.436991] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: SUCCESS [ 1132.437246] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 deletion is rescheduled due to dependency. [ 1132.437392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.620957] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.130395] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.130564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.130638] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.130863] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.130980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.131233] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c is going to be created. [ 1133.159361] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.159488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.159488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.159672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.159830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.170165] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c in Status: UNINITIALIZED for 2s [ 1134.121205] env[65359]: INFO networking_nsxv3.common.synchronization [req-a460fab5-e846-4671-9eb9-df82418c23df req-cba2d287-7354-43d6-80e2-57cba4ab02d6 tempest-ServerActionsTestOtherB-968321773 tempest-ServerActionsTestOtherB-968321773-project-member] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1134.121727] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1134.122033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.122317] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.122424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.122662] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.122857] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.122982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.123083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.123301] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.123371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.123488] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.436774] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-400 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.437042] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.437042] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.437334] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.437718] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.437843] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.437974] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.438301] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.438489] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.438804] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1134.438930] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1134.439052] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1134.439158] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1134.439282] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1134.439386] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1134.439527] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1134.528019] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1134.528019] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.088 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1134.528019] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1134.528019] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.528019] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-1c8e92b0-43df-4b25-87d8-1709eb71b612 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.528333] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-1c8e92b0-43df-4b25-87d8-1709eb71b612" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.528455] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-1c8e92b0-43df-4b25-87d8-1709eb71b612" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.528786] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-1c8e92b0-43df-4b25-87d8-1709eb71b612" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.528917] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c8e92b0-43df-4b25-87d8-1709eb71b612',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.697017] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.697208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.697261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.697534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.697534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.697792] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.697884] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.697884] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.698182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.698182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.698182] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 is going to be updated. [ 1134.725984] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.726153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.726258] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.726421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.726625] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.735587] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: IN_PROGRESS for 2s [ 1135.035022] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.035022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.035022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.035022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.035022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.035022] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 1c8e92b0-43df-4b25-87d8-1709eb71b612 not found, creating... [ 1135.035022] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.035022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.035022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.035022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.035022] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.035565] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.035565] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.035565] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.035565] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.035565] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.035565] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 1c8e92b0-43df-4b25-87d8-1709eb71b612 is going to be created. [ 1135.056371] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.056687] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.056757] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.057083] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.057316] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.057534] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-1c8e92b0-43df-4b25-87d8-1709eb71b612" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.179913] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c in Status: SUCCESS [ 1135.180180] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.180390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.180627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.180822] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.180941] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.181015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.181180] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.181265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.181351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.181446] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.680143] env[65359]: INFO networking_nsxv3.common.synchronization [req-a460fab5-e846-4671-9eb9-df82418c23df req-3bb54df2-c1bf-4a0d-acba-916ec3bd26cf service nova] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_rules [ 1135.680368] env[65359]: INFO networking_nsxv3.common.synchronization [req-a460fab5-e846-4671-9eb9-df82418c23df req-3bb54df2-c1bf-4a0d-acba-916ec3bd26cf service nova] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1135.680445] env[65359]: INFO networking_nsxv3.common.synchronization [req-a460fab5-e846-4671-9eb9-df82418c23df req-3bb54df2-c1bf-4a0d-acba-916ec3bd26cf service nova] Enqueued Resource ID: 1c8e92b0-43df-4b25-87d8-1709eb71b612 with Priority: HIGHEST for action port [ 1135.680939] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_rules [ 1135.681441] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1135.681587] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8e92b0-43df-4b25-87d8-1709eb71b612 with Priority: HIGHEST for action port [ 1135.681885] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.682038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.682182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.682350] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.682449] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.683326] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.683439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.683668] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c8e92b0-43df-4b25-87d8-1709eb71b612 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.683807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c8e92b0-43df-4b25-87d8-1709eb71b612" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.683860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c8e92b0-43df-4b25-87d8-1709eb71b612" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.684053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c8e92b0-43df-4b25-87d8-1709eb71b612" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.684149] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c8e92b0-43df-4b25-87d8-1709eb71b612',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.686498] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.686498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.686498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.686498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.686498] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.686498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.686498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.686498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.686498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.686498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.686953] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.686953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.686953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.686953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.687140] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.687140] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.687219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.687326] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.687396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.687571] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.687571] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.699248] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.699486] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.699717] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.700075] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.700857] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.700857] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.700857] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.701121] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.701554] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.701554] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.701746] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.701746] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.701863] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.702344] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.702344] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.702344] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.726702] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.727356] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1135.727356] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.727572] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.727935] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-dfe145e2-800a-46b0-9817-953decded542 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.728163] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.728322] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.728703] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.729008] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfe145e2-800a-46b0-9817-953decded542',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.186188] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.186588] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.188760] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c8e92b0-43df-4b25-87d8-1709eb71b612 with status ACTIVE [ 1136.189127] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.189394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.189483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.189867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.189867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.190091] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.190271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.190539] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.190858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.190961] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.191229] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.191364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.191471] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.191675] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.191746] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.191845] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c8e92b0-43df-4b25-87d8-1709eb71b612 is going to be updated. [ 1136.193119] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c: rpc.has_security_group_logging(os_id): False [ 1136.220978] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.221197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.221325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.221574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.221722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.222062] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.222174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.222241] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.222472] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.222581] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.222855] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.222987] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.223337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.223337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.223337] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.225720] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.225720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.225720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.225720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.225720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.225720] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c is going to be created. [ 1136.227488] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.227596] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.229762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.229762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.229762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.229762] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c8e92b0-43df-4b25-87d8-1709eb71b612" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.231716] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.231903] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.232035] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.232277] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.232421] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.232600] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port dfe145e2-800a-46b0-9817-953decded542 not found, creating... [ 1136.232866] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.233040] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.233161] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.233374] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.233617] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.233782] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.233936] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.234065] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.234291] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.234428] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.234567] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: dfe145e2-800a-46b0-9817-953decded542 is going to be created. [ 1136.252883] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.253155] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.253282] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.253573] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.253785] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.254019] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.289499] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.289747] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.289849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.290155] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.290410] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.305520] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c in Status: IN_PROGRESS for 2s [ 1136.746258] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: SUCCESS [ 1136.747280] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 deletion is rescheduled due to dependency. [ 1136.747414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.747592] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.747854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.748052] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.748214] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.748260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.748409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.748509] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.748590] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.782447] env[65359]: INFO networking_nsxv3.common.synchronization [req-bf9a06a1-e26d-402d-b5bb-229e20ad4444 req-feecc065-ca4b-4ef1-92de-5d9781ae1866 tempest-DeleteServersTestJSON-2065668722 tempest-DeleteServersTestJSON-2065668722-project-member] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1136.783192] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1136.783384] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.783460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.783557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.784035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.784035] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.784035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.784242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.784396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.784511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.784628] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.996650] env[65359]: INFO networking_nsxv3.common.synchronization [req-03c2d812-71fe-481e-86c9-030623dd487d req-41fedcef-70ca-465c-a969-1f9c54492da2 service nova] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_rules [ 1136.996928] env[65359]: INFO networking_nsxv3.common.synchronization [req-03c2d812-71fe-481e-86c9-030623dd487d req-41fedcef-70ca-465c-a969-1f9c54492da2 service nova] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 1136.997199] env[65359]: INFO networking_nsxv3.common.synchronization [req-03c2d812-71fe-481e-86c9-030623dd487d req-41fedcef-70ca-465c-a969-1f9c54492da2 service nova] Enqueued Resource ID: dfe145e2-800a-46b0-9817-953decded542 with Priority: HIGHEST for action port [ 1136.997838] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_rules [ 1136.998018] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 1136.998158] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfe145e2-800a-46b0-9817-953decded542 with Priority: HIGHEST for action port [ 1136.998600] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.998707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.998758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.999023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.999153] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.000359] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.000995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.000995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.000995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.003356] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.003356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.003356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.003356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.003356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.003356] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.003356] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfe145e2-800a-46b0-9817-953decded542 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.003356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.003356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.003356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.003356] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfe145e2-800a-46b0-9817-953decded542',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.144549] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-125 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.145129] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.145129] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.145233] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.145486] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.145732] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.145783] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.145962] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.146120] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.146341] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1137.146457] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1137.146565] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1137.146669] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1137.146778] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1137.146881] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1137.147020] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1137.168106] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1137.168318] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1137.168463] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1137.168647] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-125" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.168958] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-14b926d8-b00c-4a9c-880d-98051c92ea67 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.169153] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-14b926d8-b00c-4a9c-880d-98051c92ea67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.169269] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-14b926d8-b00c-4a9c-880d-98051c92ea67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.169625] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-14b926d8-b00c-4a9c-880d-98051c92ea67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.169785] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14b926d8-b00c-4a9c-880d-98051c92ea67',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.251460] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.287344] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.287513] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.287615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.287794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.287888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.288103] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.288237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.288292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.288469] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.288546] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.288634] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 1137.316430] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.316670] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.316763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.316948] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.317105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.326738] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 1137.504950] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.505162] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.505328] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.506373] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfe145e2-800a-46b0-9817-953decded542 with status ACTIVE [ 1137.507071] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.507071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.507071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.507071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.507071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.508018] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.508018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.508018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.508018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.508018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.508018] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.508018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.508018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.508018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.509445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.509445] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfe145e2-800a-46b0-9817-953decded542 is going to be updated. [ 1137.531661] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.531857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.531857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.532070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.532208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.532398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.619430] env[65359]: INFO networking_nsxv3.common.synchronization [req-dcf4fc9f-abca-480a-b8b1-691b00974f14 req-5cf3b0c6-5fe0-453d-a2ca-5a2c0ae8a1f8 tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: 13736951-03c6-4d53-ad2b-da3bf377face with Priority: HIGHEST for action security_group_members [ 1137.620341] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13736951-03c6-4d53-ad2b-da3bf377face with Priority: HIGHEST for action security_group_members [ 1137.620341] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-13736951-03c6-4d53-ad2b-da3bf377face taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.620561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.620561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.620659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.620809] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.620908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.620974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.621132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.621222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.621346] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13736951-03c6-4d53-ad2b-da3bf377face',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.673198] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.673442] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.673637] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.673918] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.674091] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.674481] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 14b926d8-b00c-4a9c-880d-98051c92ea67 not found, creating... [ 1137.674682] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.674855] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.674964] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.675201] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.675376] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.675705] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.675861] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.675979] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.676201] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.676339] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.676484] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 14b926d8-b00c-4a9c-880d-98051c92ea67 is going to be created. [ 1137.698817] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.699054] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.699185] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.699454] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.700027] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.700027] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-14b926d8-b00c-4a9c-880d-98051c92ea67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.754482] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.009906] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.124158] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.124356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.124356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.124542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.124608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.124856] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.124958] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.124958] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.125227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.125227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.125322] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13736951-03c6-4d53-ad2b-da3bf377face is going to be updated. [ 1138.152380] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.152533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.152587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.152793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.152931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.162841] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13736951-03c6-4d53-ad2b-da3bf377face in Status: IN_PROGRESS for 2s [ 1138.256300] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.256659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.256659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.256821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.256916] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.257028] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 is going to be updated. [ 1138.289918] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.289918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.289918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.289918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.289918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.301194] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: IN_PROGRESS for 2s [ 1138.319999] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c in Status: SUCCESS [ 1138.320286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.424602] env[65359]: INFO networking_nsxv3.common.synchronization [req-bf9a06a1-e26d-402d-b5bb-229e20ad4444 req-9ec6762a-fabe-4776-9e75-bd1c85e3e623 service nova] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_rules [ 1138.424827] env[65359]: INFO networking_nsxv3.common.synchronization [req-bf9a06a1-e26d-402d-b5bb-229e20ad4444 req-9ec6762a-fabe-4776-9e75-bd1c85e3e623 service nova] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1138.424901] env[65359]: INFO networking_nsxv3.common.synchronization [req-bf9a06a1-e26d-402d-b5bb-229e20ad4444 req-9ec6762a-fabe-4776-9e75-bd1c85e3e623 service nova] Enqueued Resource ID: 14b926d8-b00c-4a9c-880d-98051c92ea67 with Priority: HIGHEST for action port [ 1138.425479] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_rules [ 1138.425612] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1138.425706] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b926d8-b00c-4a9c-880d-98051c92ea67 with Priority: HIGHEST for action port [ 1138.425984] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.426488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.426576] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.426825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.426891] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.427886] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.427990] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.429273] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-14b926d8-b00c-4a9c-880d-98051c92ea67 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.429273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14b926d8-b00c-4a9c-880d-98051c92ea67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.429273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14b926d8-b00c-4a9c-880d-98051c92ea67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.429273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14b926d8-b00c-4a9c-880d-98051c92ea67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.429273] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14b926d8-b00c-4a9c-880d-98051c92ea67',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.512776] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.512953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.512992] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.513202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.513298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.513400] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be created. [ 1138.541694] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.541870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.541936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.542135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.542321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.554724] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: UNINITIALIZED for 2s [ 1138.930636] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.930760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.930983] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14b926d8-b00c-4a9c-880d-98051c92ea67 with status ACTIVE [ 1138.931169] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.931288] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.931348] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.931593] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.931687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.931862] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.931958] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.932032] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.932270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.932360] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.932545] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.932638] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.932693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.932828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.932900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.933025] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14b926d8-b00c-4a9c-880d-98051c92ea67 is going to be updated. [ 1138.958145] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.958318] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.958396] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.958614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.958754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.958909] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14b926d8-b00c-4a9c-880d-98051c92ea67" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.339194] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 1139.339779] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb deletion is rescheduled due to dependency. [ 1139.340020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.341030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.341030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.341030] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.341030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.341030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.341287] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.341287] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.341287] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.843706] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.172744] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13736951-03c6-4d53-ad2b-da3bf377face in Status: SUCCESS [ 1140.172922] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13736951-03c6-4d53-ad2b-da3bf377face deletion is rescheduled due to dependency. [ 1140.173048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13736951-03c6-4d53-ad2b-da3bf377face" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.311224] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: SUCCESS [ 1140.311597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.311855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.312213] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.312532] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.312743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.313930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.313930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.314325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.314503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.314679] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.348990] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.566606] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 1140.566779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.566858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.567124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.567376] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.567557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.567666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.567965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.568092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.568192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.568338] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.817666] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.853993] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.853993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.853993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.853993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.853993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.853993] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 1140.894125] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.894125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.894125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.894125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.894125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.906892] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 1140.939145] env[65359]: INFO networking_nsxv3.common.synchronization [req-2edf5c52-e6f0-4862-a273-0e765ee7f150 req-bada995a-c0a6-4e6c-91ac-810d38f800fe tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_members [ 1140.939145] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_members [ 1140.939657] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb52c5b-5242-481b-b676-5b24fc2c97d8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.939937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.940150] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.940613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.940885] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.941146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.941350] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.941711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.941905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.942140] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.072160] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.075020] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.075020] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.075020] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.075020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.075789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.076018] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.231618] env[65359]: INFO networking_nsxv3.common.synchronization [req-d4c546ce-9b0c-4f50-946a-32e87c6bf7f2 req-0bf033d8-2d89-4015-a2ae-a9fed8ebf021 tempest-ServerRescueTestJSON-579547403 tempest-ServerRescueTestJSON-579547403-project-member] Enqueued Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_members [ 1141.231618] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGHEST for action security_group_members [ 1141.231618] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.231841] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.232011] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.232393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.232672] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.232897] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.233060] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.233707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.233927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.234146] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.322032] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93f7f41b-56ed-4593-aafe-31057cf7c6f5: rpc.has_security_group_logging(os_id): False [ 1141.341558] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.345042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.345042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.345042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.345042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.345042] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.345042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.345042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.345042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.345042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.345042] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 is going to be updated. [ 1141.390489] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-854 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.390847] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.391040] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.391506] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.391941] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.392234] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.392467] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.392843] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.393118] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.393464] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.393688] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.393905] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.394142] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.394376] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.394585] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.394808] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.408573] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.408808] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.408926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.409263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.409473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.419361] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.419606] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1141.419840] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.420145] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.420633] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-6d47c9d9-d268-4da8-941c-b718d7c41dd8 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.420923] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-6d47c9d9-d268-4da8-941c-b718d7c41dd8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.421145] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-6d47c9d9-d268-4da8-941c-b718d7c41dd8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.421516] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-6d47c9d9-d268-4da8-941c-b718d7c41dd8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.421874] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d47c9d9-d268-4da8-941c-b718d7c41dd8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.423939] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: IN_PROGRESS for 2s [ 1141.450634] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.450940] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.450940] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.451943] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.451943] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.451943] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.452287] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.452496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.453189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.453189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.453189] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 already deleted. [ 1141.453379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.580043] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3: rpc.has_security_group_logging(os_id): False [ 1141.708023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.708023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.708023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.708023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.708023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.708357] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.708357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.708357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.708580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.708580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.710167] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.710167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.710167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.710167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.710167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.710167] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.710167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.710167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.710167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.710167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.710167] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be created. [ 1141.736298] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.737182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.737182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.737182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.737182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.737182] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.737371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.737371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.738040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.738040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.738040] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07f94052-66b8-4ea9-9b43-7b740cc698df is going to be updated. [ 1141.780019] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.780262] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.780532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.780760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.780885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.793088] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.793088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.793088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.793088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.793088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.798975] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07f94052-66b8-4ea9-9b43-7b740cc698df in Status: IN_PROGRESS for 2s [ 1141.813476] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 2s [ 1141.925101] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.925349] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.925499] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.925792] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.925940] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.926114] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 6d47c9d9-d268-4da8-941c-b718d7c41dd8 not found, creating... [ 1141.926402] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.926582] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.926731] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.926950] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.927143] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.927449] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.927601] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.927710] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.927907] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.928396] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.928624] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 6d47c9d9-d268-4da8-941c-b718d7c41dd8 is going to be created. [ 1141.956522] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.956797] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.956929] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.957241] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.957493] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.957747] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-6d47c9d9-d268-4da8-941c-b718d7c41dd8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.693229] env[65359]: INFO networking_nsxv3.common.synchronization [req-2edf5c52-e6f0-4862-a273-0e765ee7f150 req-c4df6c20-05fd-42a6-a96b-fee1889a6da5 service nova] Enqueued Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_rules [ 1142.693495] env[65359]: INFO networking_nsxv3.common.synchronization [req-2edf5c52-e6f0-4862-a273-0e765ee7f150 req-c4df6c20-05fd-42a6-a96b-fee1889a6da5 service nova] Enqueued Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_members [ 1142.693685] env[65359]: INFO networking_nsxv3.common.synchronization [req-2edf5c52-e6f0-4862-a273-0e765ee7f150 req-c4df6c20-05fd-42a6-a96b-fee1889a6da5 service nova] Enqueued Resource ID: 6d47c9d9-d268-4da8-941c-b718d7c41dd8 with Priority: HIGHEST for action port [ 1142.694311] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_rules [ 1142.694477] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_members [ 1142.694579] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d47c9d9-d268-4da8-941c-b718d7c41dd8 with Priority: HIGHEST for action port [ 1142.694855] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.694981] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.695397] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.695640] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.695734] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.697385] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb52c5b-5242-481b-b676-5b24fc2c97d8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.697880] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.697983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.698183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.698352] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.698483] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.698973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.699149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.699243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.699357] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.700225] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d47c9d9-d268-4da8-941c-b718d7c41dd8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.700347] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d47c9d9-d268-4da8-941c-b718d7c41dd8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.700422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d47c9d9-d268-4da8-941c-b718d7c41dd8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.700550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d47c9d9-d268-4da8-941c-b718d7c41dd8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.700633] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d47c9d9-d268-4da8-941c-b718d7c41dd8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.918228] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 1142.918464] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.918634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.918864] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.919070] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.919191] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.919257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.919419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.919535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.919634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.919727] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.202788] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb52c5b-5242-481b-b676-5b24fc2c97d8 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.202959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.204339] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d47c9d9-d268-4da8-941c-b718d7c41dd8 with status ACTIVE [ 1143.204598] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.204752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.204823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.205050] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.205134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.205346] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.205454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.205512] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.205664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.205736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.205918] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.206020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.206077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.206217] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.206295] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.206379] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d47c9d9-d268-4da8-941c-b718d7c41dd8 is going to be updated. [ 1143.207555] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.231742] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.231974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.231974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.232247] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.232425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.232721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d47c9d9-d268-4da8-941c-b718d7c41dd8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.422422] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.422666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.422752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.422950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.423181] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.423295] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.423356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.423581] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.423668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.423758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.423991] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.424119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.424208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.424579] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.424697] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.424806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.424861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.425030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.425138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.425231] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.425426] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.448955] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: SUCCESS [ 1143.449255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.712296] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.810334] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07f94052-66b8-4ea9-9b43-7b740cc698df in Status: SUCCESS [ 1143.810515] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07f94052-66b8-4ea9-9b43-7b740cc698df deletion is rescheduled due to dependency. [ 1143.810630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.828947] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 1143.829286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.929372] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6b655ed-9de5-4842-96d3-3652c9e45ddb: rpc.has_security_group_logging(os_id): False [ 1143.948522] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.948687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.948761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.948977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.949083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.949303] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.949404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.949467] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.949656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.949758] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.949939] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.950046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.950107] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.950324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.950418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.950610] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.950706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.950759] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.950895] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.950971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.951059] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 1144.013653] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.013828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.013828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.013994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.014153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.044987] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 1144.215570] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.215729] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.215806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.216043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.216138] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.216245] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 is going to be created. [ 1144.240495] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.240669] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.240849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.241086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.241745] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.251561] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: UNINITIALIZED for 2s [ 1145.747929] env[65359]: INFO networking_nsxv3.common.synchronization [req-3647fa94-7c92-4afd-9ca1-8c2803c07398 req-7abb9c33-877b-40c4-9907-48542a86b997 tempest-ServersTestJSON-1929866617 tempest-ServersTestJSON-1929866617-project-member] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1145.750094] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1145.750094] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.750094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.750094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.750094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.750094] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.750366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.750366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.750478] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.750514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.750619] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.789881] env[65359]: INFO networking_nsxv3.common.synchronization [req-9c78e933-9377-478b-963c-8d3ab98c5b89 req-00f76f89-b12f-4c96-a7e6-3155c1241107 tempest-ServerMetadataTestJSON-1795233240 tempest-ServerMetadataTestJSON-1795233240-project-member] Enqueued Resource ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c with Priority: HIGHEST for action security_group_members [ 1145.791497] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c with Priority: HIGHEST for action security_group_members [ 1145.792371] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.792661] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.792887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.793366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.793782] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.794059] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.794392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.794867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.795157] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.795441] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.064850] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 1146.065132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.101753] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.101954] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.102953] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.102953] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.102953] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.102953] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.102953] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.103233] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.103267] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.103807] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.103807] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.103807] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.104033] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.104072] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.104653] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.104653] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.123796] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.124015] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1146.124175] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.124384] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-529" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.124725] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-8b023e18-2b60-4854-a67e-f764db54f881 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.124897] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-8b023e18-2b60-4854-a67e-f764db54f881" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.125024] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-8b023e18-2b60-4854-a67e-f764db54f881" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.125419] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-8b023e18-2b60-4854-a67e-f764db54f881" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.125612] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b023e18-2b60-4854-a67e-f764db54f881',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.254771] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.264216] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: SUCCESS [ 1146.264484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.264668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.264910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.265169] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.265379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.265488] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.265706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.265848] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.265962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.266083] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.298897] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.299159] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.299311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.299449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.299548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.299930] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.300356] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.300454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.300682] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.300769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.300873] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c is going to be updated. [ 1146.331526] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.331704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.331773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.332038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.332202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.341158] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c in Status: IN_PROGRESS for 2s [ 1146.630976] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.630976] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.631179] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.631450] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.631602] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.631759] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 8b023e18-2b60-4854-a67e-f764db54f881 not found, creating... [ 1146.632060] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.632242] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.632377] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.632610] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.632745] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.633068] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.633233] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.633348] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.633553] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.633741] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.633888] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 8b023e18-2b60-4854-a67e-f764db54f881 is going to be created. [ 1146.657623] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.657869] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.658007] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.658284] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.658501] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.658712] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-8b023e18-2b60-4854-a67e-f764db54f881" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.756916] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.768600] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.259239] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.259446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.259519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.259759] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.260110] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.260110] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 1147.271048] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cfb52c5b-5242-481b-b676-5b24fc2c97d8: rpc.has_security_group_logging(os_id): False [ 1147.289499] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.289683] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.289757] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.290196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.290196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.290662] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.290662] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.290662] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.290790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.290830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.290925] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 is going to be created. [ 1147.292983] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.293182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.293182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.293412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.293484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.304590] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 1147.371200] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.371454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.371454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.371641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.371806] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.380240] env[65359]: INFO networking_nsxv3.common.synchronization [req-3647fa94-7c92-4afd-9ca1-8c2803c07398 req-cd6e1dd0-535a-45b4-9ba3-52f975cac30e service nova] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_rules [ 1147.380429] env[65359]: INFO networking_nsxv3.common.synchronization [req-3647fa94-7c92-4afd-9ca1-8c2803c07398 req-cd6e1dd0-535a-45b4-9ba3-52f975cac30e service nova] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1147.380561] env[65359]: INFO networking_nsxv3.common.synchronization [req-3647fa94-7c92-4afd-9ca1-8c2803c07398 req-cd6e1dd0-535a-45b4-9ba3-52f975cac30e service nova] Enqueued Resource ID: 8b023e18-2b60-4854-a67e-f764db54f881 with Priority: HIGHEST for action port [ 1147.381189] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_rules [ 1147.381396] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1147.381653] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b023e18-2b60-4854-a67e-f764db54f881 with Priority: HIGHEST for action port [ 1147.382114] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.382325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.382498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.382741] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.382874] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.384147] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.384387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.384650] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b023e18-2b60-4854-a67e-f764db54f881 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.384766] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b023e18-2b60-4854-a67e-f764db54f881" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.384834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b023e18-2b60-4854-a67e-f764db54f881" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.385096] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b023e18-2b60-4854-a67e-f764db54f881" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.385178] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b023e18-2b60-4854-a67e-f764db54f881',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.387013] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: IN_PROGRESS for 2s [ 1147.888472] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.888844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.893085] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b023e18-2b60-4854-a67e-f764db54f881 with status ACTIVE [ 1147.893447] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.893447] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.893597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.893715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.893807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.893996] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.894144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.894207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.894409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.894477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.894770] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.894770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.894881] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.894967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.895026] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.895096] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b023e18-2b60-4854-a67e-f764db54f881 is going to be updated. [ 1147.946080] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.946226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.946304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.946520] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.946677] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.946837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b023e18-2b60-4854-a67e-f764db54f881" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.356509] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c in Status: SUCCESS [ 1148.356509] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c deletion is rescheduled due to dependency. [ 1148.356509] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.314523] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 1149.314943] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.314943] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.315209] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.315517] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.315713] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.315804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.316037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.316505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.316505] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.398848] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: SUCCESS [ 1149.399076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.820751] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.323707] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.826262] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.826493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.826559] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.826827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.826928] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.827014] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 1150.859475] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.859673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.859723] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.859926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.860088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.870528] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 1152.061033] env[65359]: INFO networking_nsxv3.common.synchronization [None req-8af1ffa0-d2b4-4584-b196-21f793de08e1 None None] Enqueued Resource ID: 064a6960-281f-4a01-9be5-facb0a53f4c6 with Priority: HIGHEST for action port [ 1152.061707] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 064a6960-281f-4a01-9be5-facb0a53f4c6 with Priority: HIGHEST for action port [ 1152.063024] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-064a6960-281f-4a01-9be5-facb0a53f4c6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.063024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-064a6960-281f-4a01-9be5-facb0a53f4c6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.063024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-064a6960-281f-4a01-9be5-facb0a53f4c6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.063024] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-064a6960-281f-4a01-9be5-facb0a53f4c6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.063024] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('064a6960-281f-4a01-9be5-facb0a53f4c6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.571353] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 064a6960-281f-4a01-9be5-facb0a53f4c6 [ 1152.571353] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.571353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.571353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.571353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.571893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.571893] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:064a6960-281f-4a01-9be5-facb0a53f4c6 already deleted. [ 1152.572203] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-064a6960-281f-4a01-9be5-facb0a53f4c6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.883414] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 1152.883652] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.883834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.884112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.884303] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.884507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.884570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.884974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.884974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.884974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.884974] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.029974] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.030225] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-376" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.030389] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-376" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.031061] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-376" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.031634] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.031634] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.031634] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.031823] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.031961] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.032268] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1153.032399] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1153.033323] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1153.033323] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1153.033323] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1153.033323] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1153.033323] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.055923] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.056107] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1153.057997] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.057997] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-376" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.057997] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-8a7575cb-1178-4065-a543-a453c30bb1d9 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.057997] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.057997] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.057997] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.057997] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a7575cb-1178-4065-a543-a453c30bb1d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.389393] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.389900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.389900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.389900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.390078] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.390078] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.390157] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.390306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.390399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.390500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.390652] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.390750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.390855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.390952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.391110] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.391206] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.391269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.391420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.391494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.391580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.391673] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.561407] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.561656] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.561788] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.562083] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.562241] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.563335] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.563335] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.563335] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.563335] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.563335] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.563539] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.563751] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.563751] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.563966] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.564290] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.564640] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 8a7575cb-1178-4065-a543-a453c30bb1d9 is going to be updated. [ 1153.586677] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.586916] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.587047] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.587326] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.587525] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.587800] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.900089] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5: rpc.has_security_group_logging(os_id): False [ 1153.925788] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.925996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.926085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.926304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.926385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.926621] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.926742] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.926974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.926974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.927056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.927261] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.927358] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.927521] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.927629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.927706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.928669] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.928743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.928827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.928983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.929086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.929191] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 1154.005649] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.005887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.006014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.006349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.006569] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.022669] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 1154.315531] env[65359]: INFO networking_nsxv3.common.synchronization [req-dc080780-23b4-426f-8a90-0c82b62d3b81 req-0e2d13ae-a9b5-47ac-95ed-7b1a81b1f43f service nova] Enqueued Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_rules [ 1154.316035] env[65359]: INFO networking_nsxv3.common.synchronization [req-dc080780-23b4-426f-8a90-0c82b62d3b81 req-0e2d13ae-a9b5-47ac-95ed-7b1a81b1f43f service nova] Enqueued Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_members [ 1154.316236] env[65359]: INFO networking_nsxv3.common.synchronization [req-dc080780-23b4-426f-8a90-0c82b62d3b81 req-0e2d13ae-a9b5-47ac-95ed-7b1a81b1f43f service nova] Enqueued Resource ID: 8a7575cb-1178-4065-a543-a453c30bb1d9 with Priority: HIGHEST for action port [ 1154.316996] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_rules [ 1154.317184] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_members [ 1154.317287] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a7575cb-1178-4065-a543-a453c30bb1d9 with Priority: HIGHEST for action port [ 1154.317634] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.317759] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.317816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.318352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.318440] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.319394] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.322142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.322821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.322821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.323014] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.323266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.323301] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.323589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.323706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.324783] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.326360] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a7575cb-1178-4065-a543-a453c30bb1d9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.326493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.326539] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.327448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.327448] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a7575cb-1178-4065-a543-a453c30bb1d9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.366810] env[65359]: INFO networking_nsxv3.common.synchronization [None req-89086cdf-fd48-4fcd-9996-386bfb0ba5a7 tempest-ServersTestFqdnHostnames-1212627849 tempest-ServersTestFqdnHostnames-1212627849-project-member] Enqueued Resource ID: 8f60147d-b931-488d-876e-01830746f0e5 with Priority: HIGHEST for action security_group_rules [ 1154.367500] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f60147d-b931-488d-876e-01830746f0e5 with Priority: HIGHEST for action security_group_rules [ 1154.367814] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f60147d-b931-488d-876e-01830746f0e5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.367981] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.369603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.369603] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.369603] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f60147d-b931-488d-876e-01830746f0e5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.473534] env[65359]: INFO networking_nsxv3.common.synchronization [None req-770ebbbf-4bd3-42e5-8dde-eb0df1d63603 tempest-ServersTestFqdnHostnames-1212627849 tempest-ServersTestFqdnHostnames-1212627849-project-member] Enqueued Resource ID: 8f60147d-b931-488d-876e-01830746f0e5 with Priority: HIGHEST for action security_group_rules [ 1154.473534] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f60147d-b931-488d-876e-01830746f0e5 with Priority: HIGHEST for action security_group_rules [ 1154.473534] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f60147d-b931-488d-876e-01830746f0e5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.473534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.636965] env[65359]: INFO networking_nsxv3.common.synchronization [None req-8778677b-d159-4e60-a22f-b2b45b82eddb None None] Enqueued Resource ID: 406d1656-38e8-412d-a7ab-55297e908a5c with Priority: HIGHEST for action port [ 1154.636965] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406d1656-38e8-412d-a7ab-55297e908a5c with Priority: HIGHEST for action port [ 1154.636965] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-406d1656-38e8-412d-a7ab-55297e908a5c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.636965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-406d1656-38e8-412d-a7ab-55297e908a5c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.636965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-406d1656-38e8-412d-a7ab-55297e908a5c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.636965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-406d1656-38e8-412d-a7ab-55297e908a5c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.636965] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('406d1656-38e8-412d-a7ab-55297e908a5c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.830064] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.831099] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.831272] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.832492] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a7575cb-1178-4065-a543-a453c30bb1d9 with status ACTIVE [ 1154.832583] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.832644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.833264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.833264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.833264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.833264] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.833264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.833482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.833482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.833542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.835109] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.835109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.835109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.835109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.835109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.835109] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a7575cb-1178-4065-a543-a453c30bb1d9 is going to be updated. [ 1154.857072] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.857243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.857517] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.857802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.857945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.858131] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a7575cb-1178-4065-a543-a453c30bb1d9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.894047] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.894247] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.894318] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.894612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.894707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.894809] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f60147d-b931-488d-876e-01830746f0e5 already deleted. [ 1154.894890] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.895057] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.895259] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.895528] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f60147d-b931-488d-876e-01830746f0e5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.139547] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 406d1656-38e8-412d-a7ab-55297e908a5c [ 1155.139806] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.139973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.140073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.140282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.140371] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.140478] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:406d1656-38e8-412d-a7ab-55297e908a5c already deleted. [ 1155.140560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-406d1656-38e8-412d-a7ab-55297e908a5c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.332985] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.418781] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.419130] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.419344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.419609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.419750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.419902] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f60147d-b931-488d-876e-01830746f0e5 already deleted. [ 1155.420062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.836172] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.836650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.836650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.837124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.837361] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.837645] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31844aa-4ad6-4249-8902-93e89324b0b5 is going to be updated. [ 1155.872855] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.874332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.874332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.874558] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.875113] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.886407] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: IN_PROGRESS for 2s [ 1156.037865] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 1156.038109] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.747884] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.748155] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.748220] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.748490] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.748792] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.748922] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.749054] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.749274] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.749428] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.749798] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.749943] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.750079] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.750272] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.750353] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.750472] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.750631] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.779561] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.779823] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1156.780054] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.780258] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-131" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.780586] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-dfe145e2-800a-46b0-9817-953decded542 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.780756] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.780895] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.781212] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.781355] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfe145e2-800a-46b0-9817-953decded542',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.284692] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.285519] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.285519] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.285519] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.285519] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.285783] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.285943] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.286067] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.286294] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.286430] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.286750] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.286871] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.286980] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.287196] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.287326] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.287484] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: dfe145e2-800a-46b0-9817-953decded542 is going to be updated. [ 1157.315922] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.315922] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.315922] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.315922] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.315922] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.315922] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.897617] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: SUCCESS [ 1157.897617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.897617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.897867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.898177] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.898424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.898591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.898989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.899192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.899368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.899542] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.990523] env[65359]: INFO networking_nsxv3.common.synchronization [req-1cdf7651-ab64-4ee9-96a5-1877bca78806 req-f078d7cc-15a4-45f8-a294-ade58303028d tempest-ServerActionsTestJSON-975876043 tempest-ServerActionsTestJSON-975876043-project-member] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 1157.991082] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 1157.991765] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.991947] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.992037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.992242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.992508] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.992615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.992669] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.992838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.992912] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.993016] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.024726] env[65359]: INFO networking_nsxv3.common.synchronization [req-21535a95-563a-4271-8c53-26880abe8331 req-3c803eb6-2763-495e-9983-0ffc1c5d77d5 service nova] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_rules [ 1158.024969] env[65359]: INFO networking_nsxv3.common.synchronization [req-21535a95-563a-4271-8c53-26880abe8331 req-3c803eb6-2763-495e-9983-0ffc1c5d77d5 service nova] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 1158.025044] env[65359]: INFO networking_nsxv3.common.synchronization [req-21535a95-563a-4271-8c53-26880abe8331 req-3c803eb6-2763-495e-9983-0ffc1c5d77d5 service nova] Enqueued Resource ID: dfe145e2-800a-46b0-9817-953decded542 with Priority: HIGHEST for action port [ 1158.026409] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_rules [ 1158.026409] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 1158.026409] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfe145e2-800a-46b0-9817-953decded542 with Priority: HIGHEST for action port [ 1158.026409] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.026409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.026716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.026716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.026814] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.027788] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.027859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.027919] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.028901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.028901] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.028901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.028901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.028901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.028901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.028901] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.029674] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfe145e2-800a-46b0-9817-953decded542 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.029779] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.029876] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.030365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.030365] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfe145e2-800a-46b0-9817-953decded542',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.380657] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-227 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.381030] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.381463] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.381843] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.382129] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.382345] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.382973] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.383250] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.383406] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.383622] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1158.383736] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1158.383845] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1158.383954] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1158.384601] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1158.384747] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1158.384885] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1158.402125] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.402125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.402125] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.402395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.403096] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.403248] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.403375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.403652] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.403813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.403988] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.404261] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.404498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.404636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.404884] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.405156] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.405323] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.405471] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.405674] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.405907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.406092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.406285] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.408720] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1158.408971] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1158.409207] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1158.409456] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.409826] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-c4dae795-17e4-4b91-a3f3-66dc8ce3223a taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.410042] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-c4dae795-17e4-4b91-a3f3-66dc8ce3223a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.410205] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-c4dae795-17e4-4b91-a3f3-66dc8ce3223a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.412343] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-c4dae795-17e4-4b91-a3f3-66dc8ce3223a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.412569] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4dae795-17e4-4b91-a3f3-66dc8ce3223a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.496379] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.496531] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.496610] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.496870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.496976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.497256] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.497370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.497442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.497696] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.497837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.497967] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 is going to be updated. [ 1158.532592] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.532747] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.532808] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.533041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.533189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.534356] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.534502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.534681] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.535581] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfe145e2-800a-46b0-9817-953decded542 with status ACTIVE [ 1158.535757] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.535860] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.535923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.536121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.536207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.536393] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.536492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.536553] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.537717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.537717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.537717] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.537717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.537717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.537717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.537717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.537717] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfe145e2-800a-46b0-9817-953decded542 is going to be updated. [ 1158.548207] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: IN_PROGRESS for 2s [ 1158.565023] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.565023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.565315] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.566142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.566142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.566142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfe145e2-800a-46b0-9817-953decded542" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.914100] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a31844aa-4ad6-4249-8902-93e89324b0b5: rpc.has_security_group_logging(os_id): False [ 1158.915917] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.916131] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.916355] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.916691] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.916880] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.917073] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port c4dae795-17e4-4b91-a3f3-66dc8ce3223a not found, creating... [ 1158.917433] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.917606] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.917729] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.917955] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.918177] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.918520] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.918697] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.918917] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.920218] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.920218] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.920218] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: c4dae795-17e4-4b91-a3f3-66dc8ce3223a is going to be created. [ 1158.938187] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.938466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.938466] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.938688] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.942969] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.943174] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.943432] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.943632] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.943854] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.944088] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-c4dae795-17e4-4b91-a3f3-66dc8ce3223a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.965521] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.965794] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.966019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.966160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.966465] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.966590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.966952] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.967097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.967163] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.967333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.967409] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.967674] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.967763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.967763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.967923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.968023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.968133] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a31844aa-4ad6-4249-8902-93e89324b0b5 is going to be updated. [ 1159.039435] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.050779] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.050982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.051038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.051231] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.051472] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.067493] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: IN_PROGRESS for 2s [ 1159.542282] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.542812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.542812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.542812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.542938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.543038] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be updated. [ 1159.575401] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.575644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.575716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.575883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.576042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.588072] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 2s [ 1159.698974] env[65359]: INFO networking_nsxv3.common.synchronization [req-1cdf7651-ab64-4ee9-96a5-1877bca78806 req-ef26f484-8ee4-4848-b4ea-7b4e313ceb8c service nova] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_rules [ 1159.699199] env[65359]: INFO networking_nsxv3.common.synchronization [req-1cdf7651-ab64-4ee9-96a5-1877bca78806 req-ef26f484-8ee4-4848-b4ea-7b4e313ceb8c service nova] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 1159.699341] env[65359]: INFO networking_nsxv3.common.synchronization [req-1cdf7651-ab64-4ee9-96a5-1877bca78806 req-ef26f484-8ee4-4848-b4ea-7b4e313ceb8c service nova] Enqueued Resource ID: c4dae795-17e4-4b91-a3f3-66dc8ce3223a with Priority: HIGHEST for action port [ 1159.703022] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_rules [ 1159.703022] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 1159.703022] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dae795-17e4-4b91-a3f3-66dc8ce3223a with Priority: HIGHEST for action port [ 1159.703022] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.703022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.703022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.703022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.703022] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.703022] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.703022] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.703756] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4dae795-17e4-4b91-a3f3-66dc8ce3223a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.703756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4dae795-17e4-4b91-a3f3-66dc8ce3223a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.703845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4dae795-17e4-4b91-a3f3-66dc8ce3223a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.704016] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4dae795-17e4-4b91-a3f3-66dc8ce3223a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.704101] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4dae795-17e4-4b91-a3f3-66dc8ce3223a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.205925] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.206243] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.208663] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4dae795-17e4-4b91-a3f3-66dc8ce3223a with status ACTIVE [ 1160.208968] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.209251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.209321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.209560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.209712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.210049] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.210366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.210366] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.210555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.210657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.211545] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.211545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.211545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.211545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.211814] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.211814] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4dae795-17e4-4b91-a3f3-66dc8ce3223a is going to be updated. [ 1160.235152] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.235309] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.235804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.235804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.235804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.235953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4dae795-17e4-4b91-a3f3-66dc8ce3223a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.558910] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: SUCCESS [ 1160.559305] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 deletion is rescheduled due to dependency. [ 1160.559305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.559446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.559693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.559877] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.559995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.560061] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.560218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.560295] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.560394] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.062616] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.081755] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: SUCCESS [ 1161.082075] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.565875] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.601722] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 1161.601722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.601722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.601722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.601722] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.602273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.602273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.602273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.602273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.602273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.602273] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.744287] env[65359]: INFO networking_nsxv3.common.synchronization [req-579338bb-a442-4f36-bcca-482b2298177f req-206a2967-1a77-4d33-9f5c-db518ca104e0 tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGHEST for action security_group_members [ 1161.745920] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGHEST for action security_group_members [ 1161.745920] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0a461a8-ce41-468d-b9bb-19fef2690b98 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.745920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.745920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.745920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.745920] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.745920] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.746726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.746726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.746726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.746726] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0a461a8-ce41-468d-b9bb-19fef2690b98',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.068966] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.069163] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.069263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.069447] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.069582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.069627] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 is going to be updated. [ 1162.102022] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.102289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.102289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.102481] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.102626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.104357] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.104582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.104582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.104738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.104917] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.105033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.105116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.105301] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.105301] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.105402] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.105554] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.105666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.105731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.105877] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.106036] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.106116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.106166] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.106312] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.106382] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.106463] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.106547] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.112887] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: IN_PROGRESS for 2s [ 1162.250723] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.250932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.250979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.251265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.251455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.251883] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.251883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.251883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.251883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.252182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.252182] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 is going to be updated. [ 1162.284476] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.284711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.285388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.285388] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.286200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.309504] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 in Status: IN_PROGRESS for 2s [ 1162.376498] env[65359]: INFO networking_nsxv3.common.synchronization [req-58e08142-0ec9-4c93-8c1e-1a6a4e595853 req-fca2685c-6315-4f2e-b8da-7f414c60e20b tempest-ServersTestFqdnHostnames-1212627849 tempest-ServersTestFqdnHostnames-1212627849-project-member] Enqueued Resource ID: 8f60147d-b931-488d-876e-01830746f0e5 with Priority: HIGHEST for action security_group_members [ 1162.377059] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f60147d-b931-488d-876e-01830746f0e5 with Priority: HIGHEST for action security_group_members [ 1162.377415] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f60147d-b931-488d-876e-01830746f0e5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.377545] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.377615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.378111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.379045] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.380143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.380143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.380143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.380143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.380143] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f60147d-b931-488d-876e-01830746f0e5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.608484] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3: rpc.has_security_group_logging(os_id): False [ 1162.630682] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.630896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.630989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.631240] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.631377] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.631597] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.631707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.631783] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.632146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.632146] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.632337] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.632540] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.632624] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.632796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.633184] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.633184] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.633293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.633327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.633586] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.633586] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.633694] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be updated. [ 1162.743578] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.743765] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.743765] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.744019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.744175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.769357] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 2s [ 1162.788880] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.789134] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-856" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.789299] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-856" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.789642] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-856" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.789913] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.790235] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.790235] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.790453] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.790615] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.790823] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.790935] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1162.791055] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1162.791163] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1162.791271] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.791374] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1162.791508] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1162.857201] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1162.857201] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.065 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1162.857201] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1162.857698] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-856" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.858133] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-df1d38d6-d7a9-462a-a706-49a5008afeb1 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.858316] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-df1d38d6-d7a9-462a-a706-49a5008afeb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.858432] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-df1d38d6-d7a9-462a-a706-49a5008afeb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.858778] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-df1d38d6-d7a9-462a-a706-49a5008afeb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.858920] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df1d38d6-d7a9-462a-a706-49a5008afeb1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.882242] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.882528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.882528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.882653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.882778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.882921] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.883803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.883803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.883803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.883803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.883803] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f60147d-b931-488d-876e-01830746f0e5 already deleted. [ 1162.883803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.362507] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.362763] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.362890] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.363782] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.363782] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.363782] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port df1d38d6-d7a9-462a-a706-49a5008afeb1 not found, creating... [ 1163.363782] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.363991] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.364072] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.364280] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.364468] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.364752] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.364910] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.365038] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.365247] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.366074] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.366074] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: df1d38d6-d7a9-462a-a706-49a5008afeb1 is going to be created. [ 1163.385819] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.385819] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.385819] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.385819] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.386175] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.386253] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-df1d38d6-d7a9-462a-a706-49a5008afeb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.108873] env[65359]: INFO networking_nsxv3.common.synchronization [req-58e08142-0ec9-4c93-8c1e-1a6a4e595853 req-eeeaf1a4-c11e-44d3-aa87-8f5e75f13e4c service nova] Enqueued Resource ID: 8f60147d-b931-488d-876e-01830746f0e5 with Priority: HIGHEST for action security_group_rules [ 1164.109261] env[65359]: INFO networking_nsxv3.common.synchronization [req-58e08142-0ec9-4c93-8c1e-1a6a4e595853 req-eeeaf1a4-c11e-44d3-aa87-8f5e75f13e4c service nova] Enqueued Resource ID: 8f60147d-b931-488d-876e-01830746f0e5 with Priority: HIGHEST for action security_group_members [ 1164.109322] env[65359]: INFO networking_nsxv3.common.synchronization [req-58e08142-0ec9-4c93-8c1e-1a6a4e595853 req-eeeaf1a4-c11e-44d3-aa87-8f5e75f13e4c service nova] Enqueued Resource ID: df1d38d6-d7a9-462a-a706-49a5008afeb1 with Priority: HIGHEST for action port [ 1164.109960] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f60147d-b931-488d-876e-01830746f0e5 with Priority: HIGHEST for action security_group_rules [ 1164.110430] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f60147d-b931-488d-876e-01830746f0e5 with Priority: HIGHEST for action security_group_members [ 1164.110549] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df1d38d6-d7a9-462a-a706-49a5008afeb1 with Priority: HIGHEST for action port [ 1164.112183] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f60147d-b931-488d-876e-01830746f0e5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.112387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.112443] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.112725] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.112816] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f60147d-b931-488d-876e-01830746f0e5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.113834] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f60147d-b931-488d-876e-01830746f0e5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.113973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.114036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.114222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.114798] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.114905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.114977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.115152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.115240] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.115339] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f60147d-b931-488d-876e-01830746f0e5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.120033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-df1d38d6-d7a9-462a-a706-49a5008afeb1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.120244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df1d38d6-d7a9-462a-a706-49a5008afeb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.120244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df1d38d6-d7a9-462a-a706-49a5008afeb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.120518] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df1d38d6-d7a9-462a-a706-49a5008afeb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.120518] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df1d38d6-d7a9-462a-a706-49a5008afeb1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.134599] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: SUCCESS [ 1164.134842] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.135433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.135676] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.137270] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.137687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.137687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.137687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.137975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.137975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.137975] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.320885] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 in Status: SUCCESS [ 1164.320885] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 deletion is rescheduled due to dependency. [ 1164.320885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.622880] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f60147d-b931-488d-876e-01830746f0e5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.624062] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f60147d-b931-488d-876e-01830746f0e5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.624237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.625279] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df1d38d6-d7a9-462a-a706-49a5008afeb1 with status ACTIVE [ 1164.625500] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.625793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.625793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.626122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.626282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.626551] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.626917] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.626917] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.627470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.627470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.627470] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.627645] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.627728] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.628060] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.628060] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.628196] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df1d38d6-d7a9-462a-a706-49a5008afeb1 is going to be updated. [ 1164.642960] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.652221] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.652419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.652515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.653294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.653294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.653294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df1d38d6-d7a9-462a-a706-49a5008afeb1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.797030] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 1164.797273] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.126067] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f60147d-b931-488d-876e-01830746f0e5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.145077] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3577cfc-adec-4c56-bc24-6acdb8887663: rpc.has_security_group_logging(os_id): False [ 1165.165057] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.165223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.165296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.165581] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.165717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.165936] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.166019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.166096] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.166226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.166306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.166394] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 is going to be updated. [ 1165.229908] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.230090] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.230153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.230365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.230515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.243150] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: IN_PROGRESS for 2s [ 1165.628455] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.628638] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.628714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.628956] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.629051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.629160] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f60147d-b931-488d-876e-01830746f0e5 is going to be created. [ 1165.658543] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.658737] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.658803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.659030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.659237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.671120] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f60147d-b931-488d-876e-01830746f0e5 in Status: UNINITIALIZED for 2s [ 1166.710969] env[65359]: INFO networking_nsxv3.common.synchronization [None req-0ffb2b07-db87-4e76-8632-81927c13b249 tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 with Priority: HIGHEST for action security_group_rules [ 1166.712320] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 with Priority: HIGHEST for action security_group_rules [ 1166.713993] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71e93a62-f682-47ff-92e4-1f8bd5455449 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.713993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.713993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.713993] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.713993] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71e93a62-f682-47ff-92e4-1f8bd5455449',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.801761] env[65359]: INFO networking_nsxv3.common.synchronization [None req-b51c2e69-8f69-442f-ae27-b5a38b402216 tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 with Priority: HIGHEST for action security_group_rules [ 1166.801761] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 with Priority: HIGHEST for action security_group_rules [ 1166.801761] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71e93a62-f682-47ff-92e4-1f8bd5455449 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.801761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.072080] env[65359]: INFO networking_nsxv3.common.synchronization [req-24147e40-fb02-44ea-b08e-6679c3f87299 req-1b3292cb-edb3-4ee9-a066-d8fc6b47525c tempest-ServersTestJSON-1929866617 tempest-ServersTestJSON-1929866617-project-member] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1167.072080] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1167.072588] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.072904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.073175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.075065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.075065] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.075065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.075065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.075065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.075065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.075065] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.236873] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.236873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.237014] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.237223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.237370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.237370] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 already deleted. [ 1167.237429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.237564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.237714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.237794] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71e93a62-f682-47ff-92e4-1f8bd5455449',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.259421] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: SUCCESS [ 1167.259421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.577766] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.684605] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f60147d-b931-488d-876e-01830746f0e5 in Status: SUCCESS [ 1167.684968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.685190] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.685421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.685805] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.685955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.686036] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.686227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.686336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.686441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.686569] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f60147d-b931-488d-876e-01830746f0e5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.770466] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.770816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.770816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.771222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.771333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.771454] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 already deleted. [ 1167.771548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.080833] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.191244] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f60147d-b931-488d-876e-01830746f0e5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.584612] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.584923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.585013] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.585253] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.585348] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.585468] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 1168.630904] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.631147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.631147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.631482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.631665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.641423] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 1168.694041] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f60147d-b931-488d-876e-01830746f0e5: rpc.has_security_group_logging(os_id): False [ 1168.715730] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.715945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.715945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.716300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.716470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.716922] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.717098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.717189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.717415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.717587] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.717748] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f60147d-b931-488d-876e-01830746f0e5 is going to be created. [ 1168.808837] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.809369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.809369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.809369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.809552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.825279] env[65359]: INFO networking_nsxv3.common.synchronization [req-031b2b73-5743-4d45-83a9-72ab77307b10 req-49d7a43e-20b0-43ba-a58c-a943df11ae5d tempest-AttachVolumeShelveTestJSON-543762586 tempest-AttachVolumeShelveTestJSON-543762586-project-member] Enqueued Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_members [ 1168.825747] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3579e6-ea77-4102-ba19-0829034e0bac with Priority: HIGHEST for action security_group_members [ 1168.826404] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-db3579e6-ea77-4102-ba19-0829034e0bac taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.826404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.826571] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.826928] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.827125] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.827247] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.827315] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.827968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.827968] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.827968] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db3579e6-ea77-4102-ba19-0829034e0bac',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.830803] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f60147d-b931-488d-876e-01830746f0e5 in Status: IN_PROGRESS for 2s [ 1169.330851] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.331097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.331174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.331386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.331481] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.331675] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.331774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.331838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.331982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.332101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.332256] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db3579e6-ea77-4102-ba19-0829034e0bac is going to be updated. [ 1169.367144] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.367413] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.367484] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.367697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.367854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.378664] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db3579e6-ea77-4102-ba19-0829034e0bac in Status: IN_PROGRESS for 2s [ 1170.653707] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 1170.653707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.850621] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f60147d-b931-488d-876e-01830746f0e5 in Status: SUCCESS [ 1170.850917] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.389753] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db3579e6-ea77-4102-ba19-0829034e0bac in Status: SUCCESS [ 1171.389952] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db3579e6-ea77-4102-ba19-0829034e0bac deletion is rescheduled due to dependency. [ 1171.390116] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db3579e6-ea77-4102-ba19-0829034e0bac" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.671560] env[65359]: INFO networking_nsxv3.common.synchronization [req-f2ac7804-748b-48e1-9731-f7ff2c3ce5b7 req-b17f6904-3d38-4e50-9d5e-bbc514614116 tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 with Priority: HIGHEST for action security_group_members [ 1173.672153] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 with Priority: HIGHEST for action security_group_members [ 1173.672506] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-71e93a62-f682-47ff-92e4-1f8bd5455449 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.673062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.673062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.673062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.673211] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.673263] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.673293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.673493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.673566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.673665] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71e93a62-f682-47ff-92e4-1f8bd5455449',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.036411] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.036707] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.036898] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.037158] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.037461] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.037699] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.037869] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.038159] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.038352] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.038625] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1174.038805] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1174.038969] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1174.039106] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1174.039286] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1174.039447] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1174.039629] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1174.065040] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1174.065284] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1174.065426] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1174.065612] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.065936] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-1a90ce59-2935-499d-a41b-17cd6cc8c374 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.066120] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-1a90ce59-2935-499d-a41b-17cd6cc8c374" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.066276] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-1a90ce59-2935-499d-a41b-17cd6cc8c374" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.066602] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-1a90ce59-2935-499d-a41b-17cd6cc8c374" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.066756] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a90ce59-2935-499d-a41b-17cd6cc8c374',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.175894] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.176101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.176169] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.176401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.176506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.176764] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.176932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.177038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.177241] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.177322] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.177470] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 already deleted. [ 1174.177513] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.571500] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.571500] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.571852] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.572056] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.572294] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.572536] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 1a90ce59-2935-499d-a41b-17cd6cc8c374 not found, creating... [ 1174.573084] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.573204] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.573412] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.573701] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.573898] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.574278] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.574545] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.574731] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.575021] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.575224] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.575451] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 1a90ce59-2935-499d-a41b-17cd6cc8c374 is going to be created. [ 1174.595701] env[65359]: INFO networking_nsxv3.common.synchronization [req-96bcb3c0-2359-43f6-a092-4e11927fe7c8 req-57a00db2-5b95-4283-b30a-16cef5797278 tempest-ServersTestJSON-1929866617 tempest-ServersTestJSON-1929866617-project-member] Enqueued Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1174.596316] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 with Priority: HIGHEST for action security_group_members [ 1174.597029] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.597222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.597300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.597506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.598404] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.598404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.598404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.598404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.598404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.598404] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7b1c61-3e92-4ac1-82a4-572363e1e5a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.600095] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.600256] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.600256] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.600467] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.601393] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.601393] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-1a90ce59-2935-499d-a41b-17cd6cc8c374" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.103299] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.104335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.104980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.105602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.106030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.106498] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.107773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.107773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.107773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.107773] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.107773] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 is going to be updated. [ 1175.137739] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.138029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.138029] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.138210] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.138363] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.148731] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: IN_PROGRESS for 2s [ 1175.316602] env[65359]: INFO networking_nsxv3.common.synchronization [req-f2ac7804-748b-48e1-9731-f7ff2c3ce5b7 req-c04d9704-b675-4257-9118-207d68268c53 service nova] Enqueued Resource ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 with Priority: HIGHEST for action security_group_rules [ 1175.316748] env[65359]: INFO networking_nsxv3.common.synchronization [req-f2ac7804-748b-48e1-9731-f7ff2c3ce5b7 req-c04d9704-b675-4257-9118-207d68268c53 service nova] Enqueued Resource ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 with Priority: HIGHEST for action security_group_members [ 1175.316970] env[65359]: INFO networking_nsxv3.common.synchronization [req-f2ac7804-748b-48e1-9731-f7ff2c3ce5b7 req-c04d9704-b675-4257-9118-207d68268c53 service nova] Enqueued Resource ID: 1a90ce59-2935-499d-a41b-17cd6cc8c374 with Priority: HIGHEST for action port [ 1175.317517] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 with Priority: HIGHEST for action security_group_rules [ 1175.317658] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 with Priority: HIGHEST for action security_group_members [ 1175.317775] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a90ce59-2935-499d-a41b-17cd6cc8c374 with Priority: HIGHEST for action port [ 1175.318077] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71e93a62-f682-47ff-92e4-1f8bd5455449 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.318201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.318269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.318478] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.319031] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71e93a62-f682-47ff-92e4-1f8bd5455449',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.321102] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-71e93a62-f682-47ff-92e4-1f8bd5455449 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.321102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.321102] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.321218] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.321351] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.321453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.321520] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.321669] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.321757] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.321846] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71e93a62-f682-47ff-92e4-1f8bd5455449',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.323487] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a90ce59-2935-499d-a41b-17cd6cc8c374 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.323487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a90ce59-2935-499d-a41b-17cd6cc8c374" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.323487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a90ce59-2935-499d-a41b-17cd6cc8c374" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.323487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a90ce59-2935-499d-a41b-17cd6cc8c374" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.323487] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a90ce59-2935-499d-a41b-17cd6cc8c374',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.821982] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-71e93a62-f682-47ff-92e4-1f8bd5455449 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.822172] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.826775] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71e93a62-f682-47ff-92e4-1f8bd5455449',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.827687] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a90ce59-2935-499d-a41b-17cd6cc8c374 with status ACTIVE [ 1175.831505] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.831505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.831505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.831505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.831505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.831505] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.831505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.831505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.831505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.831505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.831505] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.831505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.831505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.831505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.832566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.832709] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a90ce59-2935-499d-a41b-17cd6cc8c374 is going to be updated. [ 1175.855641] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.855875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.855875] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.856264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.856407] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.856571] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a90ce59-2935-499d-a41b-17cd6cc8c374" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.990532] env[65359]: INFO networking_nsxv3.common.synchronization [req-9e34b23f-0b54-4549-bc2b-81ae95cdd11f req-db06ea42-56c8-4a11-b57d-c346d2aa5348 tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_members [ 1175.991120] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_members [ 1175.991430] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.991557] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.991622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.991823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.991973] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.992089] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.992151] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.992297] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.992384] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.992481] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.335013] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71e93a62-f682-47ff-92e4-1f8bd5455449',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.495350] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.837950] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.838187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.838315] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.838573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.838695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.838842] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 is going to be created. [ 1176.884602] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.884851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.884907] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.885106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.885271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.903585] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 in Status: UNINITIALIZED for 2s [ 1176.998338] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.160345] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 in Status: SUCCESS [ 1177.160536] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7b1c61-3e92-4ac1-82a4-572363e1e5a5 deletion is rescheduled due to dependency. [ 1177.160656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7b1c61-3e92-4ac1-82a4-572363e1e5a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.501562] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.501962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.501962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.502053] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.502111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.502201] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 is going to be updated. [ 1177.552035] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.552240] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.552294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.552470] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.552646] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.562775] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: IN_PROGRESS for 2s [ 1178.914307] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 in Status: SUCCESS [ 1178.914743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.914743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.914966] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.915175] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.915279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.915346] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.915496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.915647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.915647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.915732] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71e93a62-f682-47ff-92e4-1f8bd5455449',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.418330] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71e93a62-f682-47ff-92e4-1f8bd5455449',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.575251] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: SUCCESS [ 1179.575506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.920706] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71e93a62-f682-47ff-92e4-1f8bd5455449: rpc.has_security_group_logging(os_id): False [ 1179.939025] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.939186] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.939266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.939482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.939573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.939833] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.939935] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.940000] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.940160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.940237] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.940326] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 is going to be created. [ 1180.000880] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.001078] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.001122] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.001322] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.001502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.013455] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 in Status: IN_PROGRESS for 2s [ 1180.992061] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1180.992406] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1182.031052] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 in Status: SUCCESS [ 1182.031474] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.206264] env[65359]: INFO networking_nsxv3.common.synchronization [req-f810a496-5163-4882-8ba6-c32bd3e65cf3 req-88d7a5f3-2b10-4261-9854-8cc0dd534380 tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_members [ 1184.206536] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGHEST for action security_group_members [ 1184.206807] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.207294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.207375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.207643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.207766] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.207865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.208583] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.208583] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.208583] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.208583] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.710978] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.711185] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.711229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.711440] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.711534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.711739] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.711910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.711974] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.712142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.712219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.712308] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 is going to be updated. [ 1184.747958] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.748145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.748223] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.748387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.748539] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.758250] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: IN_PROGRESS for 2s [ 1186.642756] env[65359]: INFO networking_nsxv3.common.synchronization [req-229a8128-c5b6-4d86-87f6-9fb0cfb0beb5 req-b9f9da6a-cc8e-4934-8a7c-db5368256ba3 tempest-DeleteServersTestJSON-2065668722 tempest-DeleteServersTestJSON-2065668722-project-member] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1186.643313] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGHEST for action security_group_members [ 1186.643602] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.643726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.643795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.643988] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.644146] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.644244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.644304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.644446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.644529] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.644667] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.769015] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 in Status: SUCCESS [ 1186.769214] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 deletion is rescheduled due to dependency. [ 1186.769325] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.095524] env[65359]: INFO networking_nsxv3.common.synchronization [req-3e702124-a0b3-4242-9909-fd6ee34d1a32 req-bd77727f-dcff-447d-9900-04e1c7fd1da4 tempest-ServersNegativeTestJSON-839733669 tempest-ServersNegativeTestJSON-839733669-project-member] Enqueued Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_members [ 1187.096215] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31844aa-4ad6-4249-8902-93e89324b0b5 with Priority: HIGHEST for action security_group_members [ 1187.096503] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31844aa-4ad6-4249-8902-93e89324b0b5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.096918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.097042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.097250] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.097405] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.097508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.097622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.097768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.097841] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.097937] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a31844aa-4ad6-4249-8902-93e89324b0b5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.148475] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.148675] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.148722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.148913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.149025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.149212] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.149313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.149374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.149523] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.149599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.149687] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be updated. [ 1187.182015] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.182199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.182239] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.182428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.182567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.190828] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: IN_PROGRESS for 2s [ 1187.600832] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.601121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.601121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.601300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.601351] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.601553] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.601658] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.601728] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.601855] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.601924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.602017] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31844aa-4ad6-4249-8902-93e89324b0b5 is going to be updated. [ 1187.629311] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.629471] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.629551] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.629755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.629896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.653996] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: IN_PROGRESS for 2s [ 1188.161536] env[65359]: INFO networking_nsxv3.common.synchronization [None req-901ba976-ce12-4d0f-a0ba-302f6dda422a tempest-AttachInterfacesTestJSON-994156904 tempest-AttachInterfacesTestJSON-994156904-project-member] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 1188.162087] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGHEST for action security_group_members [ 1188.162393] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.162745] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.162745] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.162867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.162900] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.162999] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.163076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.163266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.163343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.163392] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.666768] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.666768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.666768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.668028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.668028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.668206] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.668346] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.668418] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.668626] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.668755] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.668873] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be updated. [ 1188.697294] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.697496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.697496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.697805] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.698055] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.707460] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 2s [ 1189.201742] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb in Status: SUCCESS [ 1189.201991] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb deletion is rescheduled due to dependency. [ 1189.202130] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.664377] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31844aa-4ad6-4249-8902-93e89324b0b5 in Status: SUCCESS [ 1189.664572] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31844aa-4ad6-4249-8902-93e89324b0b5 deletion is rescheduled due to dependency. [ 1189.664703] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31844aa-4ad6-4249-8902-93e89324b0b5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.717139] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: IN_PROGRESS for 4s [ 1192.730787] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 in Status: SUCCESS [ 1192.731072] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 deletion is rescheduled due to dependency. [ 1192.731115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.163049] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1193.163173] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1194.557681] env[65359]: INFO networking_nsxv3.common.synchronization [req-98a4c0df-f953-4d9c-946a-c7a9e49e3fe3 req-5b702fd9-c9b1-4e6e-aaeb-afb7d62df383 tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_members [ 1194.558417] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_members [ 1194.558761] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.558904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.558904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.559965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.559965] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.559965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.559965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.559965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.559965] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.559965] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.994755] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-854 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.994980] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.995128] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.995391] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.995651] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.995819] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.995939] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.996166] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.996314] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.996519] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1194.996632] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1194.996733] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1194.996844] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1194.996953] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1194.997071] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1194.997200] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1195.019870] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1195.019870] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1195.019870] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1195.019870] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.020049] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-bd903c31-a4a1-44d5-a58e-2dad30faad39 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.020158] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-bd903c31-a4a1-44d5-a58e-2dad30faad39" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.020268] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-bd903c31-a4a1-44d5-a58e-2dad30faad39" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.020587] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-bd903c31-a4a1-44d5-a58e-2dad30faad39" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.020726] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd903c31-a4a1-44d5-a58e-2dad30faad39',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.062190] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.062358] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.062442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.062644] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.062727] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.062931] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.063040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.063106] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.063249] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.063338] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.063425] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 already deleted. [ 1195.063505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.523852] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.524084] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.524186] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.524526] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.524785] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.525017] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port bd903c31-a4a1-44d5-a58e-2dad30faad39 not found, creating... [ 1195.525395] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.525607] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.525795] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.526078] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.526265] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.526601] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.526774] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.526888] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.527169] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.527309] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.527448] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: bd903c31-a4a1-44d5-a58e-2dad30faad39 is going to be created. [ 1195.549278] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.549510] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.549642] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.549953] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.550280] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.550538] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-bd903c31-a4a1-44d5-a58e-2dad30faad39" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.246696] env[65359]: INFO networking_nsxv3.common.synchronization [req-98a4c0df-f953-4d9c-946a-c7a9e49e3fe3 req-5033a2b4-44e5-4fb6-a21a-02b5b2f9a698 service nova] Enqueued Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_rules [ 1196.246983] env[65359]: INFO networking_nsxv3.common.synchronization [req-98a4c0df-f953-4d9c-946a-c7a9e49e3fe3 req-5033a2b4-44e5-4fb6-a21a-02b5b2f9a698 service nova] Enqueued Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_members [ 1196.247073] env[65359]: INFO networking_nsxv3.common.synchronization [req-98a4c0df-f953-4d9c-946a-c7a9e49e3fe3 req-5033a2b4-44e5-4fb6-a21a-02b5b2f9a698 service nova] Enqueued Resource ID: bd903c31-a4a1-44d5-a58e-2dad30faad39 with Priority: HIGHEST for action port [ 1196.249319] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_rules [ 1196.249319] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_members [ 1196.249319] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd903c31-a4a1-44d5-a58e-2dad30faad39 with Priority: HIGHEST for action port [ 1196.249319] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.249319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.249319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.249319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.249319] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.249899] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.250027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.250101] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.250282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.250427] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.250523] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.250585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.250771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.250864] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.250952] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.251721] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd903c31-a4a1-44d5-a58e-2dad30faad39 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.251829] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd903c31-a4a1-44d5-a58e-2dad30faad39" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.251896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd903c31-a4a1-44d5-a58e-2dad30faad39" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.252057] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd903c31-a4a1-44d5-a58e-2dad30faad39" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.252225] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd903c31-a4a1-44d5-a58e-2dad30faad39',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.754045] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.754045] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.754861] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.756686] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd903c31-a4a1-44d5-a58e-2dad30faad39 with status ACTIVE [ 1196.756686] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.756686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.756686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.756686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.756686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.757165] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.757307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.758562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.758777] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.758873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.759097] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.759230] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.759334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.759461] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.759540] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.759666] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd903c31-a4a1-44d5-a58e-2dad30faad39 is going to be updated. [ 1196.766597] env[65359]: INFO networking_nsxv3.common.synchronization [req-2801ab1b-7b6e-445b-85bd-a01c3c4dda30 req-2e320817-ca92-4ebb-ad97-06b87d8a8e5c tempest-ListServerFiltersTestJSON-755616435 tempest-ListServerFiltersTestJSON-755616435-project-member] Enqueued Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1196.767228] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1196.767991] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.767991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.767991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.767991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.768450] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.768450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.768450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.768450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.768622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.768622] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.782749] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.782946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.783271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.783515] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.783810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.783996] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd903c31-a4a1-44d5-a58e-2dad30faad39" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.052947] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-268 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.053221] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.053374] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.053712] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.054013] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.054195] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.054328] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.054627] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.054845] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.055069] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1197.055194] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1197.055303] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1197.055409] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1197.055514] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1197.055618] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1197.055769] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1197.082957] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1197.083153] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1197.083297] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1197.083772] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.084111] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-ddc63928-7603-4f99-a7f1-17d417fa2b3d taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.084289] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-ddc63928-7603-4f99-a7f1-17d417fa2b3d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.084413] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-ddc63928-7603-4f99-a7f1-17d417fa2b3d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.084878] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-ddc63928-7603-4f99-a7f1-17d417fa2b3d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.085032] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddc63928-7603-4f99-a7f1-17d417fa2b3d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.261865] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.271186] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.271353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.271401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.271598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.271687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.271881] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.271978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.272057] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.272205] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.272283] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.272363] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83cd6ed2-10e9-4291-bb94-80714475749a already deleted. [ 1197.272444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.587970] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.588512] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.588512] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.588674] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.588827] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.589009] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port ddc63928-7603-4f99-a7f1-17d417fa2b3d not found, creating... [ 1197.589282] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.589437] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.589566] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.589777] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.589931] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.590270] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.590434] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.590552] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.590829] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.590955] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.591109] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: ddc63928-7603-4f99-a7f1-17d417fa2b3d is going to be created. [ 1197.613574] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.613789] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.613914] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.614247] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.614441] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.614660] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-ddc63928-7603-4f99-a7f1-17d417fa2b3d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.764214] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.764393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.764455] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.764739] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.764825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.764933] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 is going to be created. [ 1197.789519] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.789667] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.789740] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.789964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.790143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.800506] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 in Status: UNINITIALIZED for 2s [ 1198.327802] env[65359]: INFO networking_nsxv3.common.synchronization [req-2801ab1b-7b6e-445b-85bd-a01c3c4dda30 req-8f9923b9-810c-4bf6-bf6e-97ece12f2113 service nova] Enqueued Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_rules [ 1198.328053] env[65359]: INFO networking_nsxv3.common.synchronization [req-2801ab1b-7b6e-445b-85bd-a01c3c4dda30 req-8f9923b9-810c-4bf6-bf6e-97ece12f2113 service nova] Enqueued Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1198.328135] env[65359]: INFO networking_nsxv3.common.synchronization [req-2801ab1b-7b6e-445b-85bd-a01c3c4dda30 req-8f9923b9-810c-4bf6-bf6e-97ece12f2113 service nova] Enqueued Resource ID: ddc63928-7603-4f99-a7f1-17d417fa2b3d with Priority: HIGHEST for action port [ 1198.328625] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_rules [ 1198.328753] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1198.328849] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddc63928-7603-4f99-a7f1-17d417fa2b3d with Priority: HIGHEST for action port [ 1198.329125] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.329242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.329307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.329574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.329647] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.330456] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.330584] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.330659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.330827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.330973] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.331078] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.331139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.331276] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.331359] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.331446] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.332144] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddc63928-7603-4f99-a7f1-17d417fa2b3d taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.332256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddc63928-7603-4f99-a7f1-17d417fa2b3d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.332305] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddc63928-7603-4f99-a7f1-17d417fa2b3d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.332951] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddc63928-7603-4f99-a7f1-17d417fa2b3d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.332951] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddc63928-7603-4f99-a7f1-17d417fa2b3d',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.834035] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.834794] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.834911] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.835288] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddc63928-7603-4f99-a7f1-17d417fa2b3d with status ACTIVE [ 1198.835448] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.835555] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.835621] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.835846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.836825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.836825] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.836825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.836825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.836825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.836825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.836825] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.836825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.836825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.837266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.837266] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.837266] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddc63928-7603-4f99-a7f1-17d417fa2b3d is going to be updated. [ 1198.861032] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.861201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.861201] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.861416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.861549] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.861706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddc63928-7603-4f99-a7f1-17d417fa2b3d" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.000453] env[65359]: INFO networking_nsxv3.common.synchronization [req-e3c6f0df-a04d-4fed-a6f4-16cea2e71932 req-2a1366f8-7918-4787-ab17-295a5dd54ef3 tempest-ListServerFiltersTestJSON-755616435 tempest-ListServerFiltersTestJSON-755616435-project-member] Enqueued Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1199.000988] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1199.001316] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.001414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.336374] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.348089] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-268 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.348291] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.348583] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.348678] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.348930] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.349103] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.349219] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.349477] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.349569] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.349769] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.349880] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1199.349976] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1199.350095] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1199.350200] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.350305] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1199.350437] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1199.369129] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1199.369302] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1199.369437] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1199.369616] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.369921] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-d9ded336-2c43-431a-ad65-549543b0a0fe taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.370095] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-d9ded336-2c43-431a-ad65-549543b0a0fe" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.370215] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-d9ded336-2c43-431a-ad65-549543b0a0fe" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.370567] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-d9ded336-2c43-431a-ad65-549543b0a0fe" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.370705] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9ded336-2c43-431a-ad65-549543b0a0fe',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.810635] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 in Status: SUCCESS [ 1199.810905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.811058] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.811278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.811494] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.811623] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.811690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.811849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.811931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.812025] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.812177] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.839047] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.839047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.839047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.839047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.839047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.839308] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83cd6ed2-10e9-4291-bb94-80714475749a is going to be created. [ 1199.866591] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.866812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.866936] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.867269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.867506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.873140] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.873454] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.873668] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.874084] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.874524] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.874566] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port d9ded336-2c43-431a-ad65-549543b0a0fe not found, creating... [ 1199.875027] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.875257] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.875391] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.875617] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.875756] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.876126] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.876285] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.876401] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.876667] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.876905] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.877166] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: d9ded336-2c43-431a-ad65-549543b0a0fe is going to be created. [ 1199.878775] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: UNINITIALIZED for 2s [ 1199.902376] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.902669] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.902755] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.902973] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.903221] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.903449] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-d9ded336-2c43-431a-ad65-549543b0a0fe" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.315235] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.315490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.315490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.315715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.315895] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.315991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.316071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.316226] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.316319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.316398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.316550] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.316671] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.316707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.316831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.316969] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.317084] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.317123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.317565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.317565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.317565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.317565] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.670613] env[65359]: INFO networking_nsxv3.common.synchronization [req-e3c6f0df-a04d-4fed-a6f4-16cea2e71932 req-34b61fd0-746b-4237-8dca-353a63bc619d service nova] Enqueued Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_rules [ 1200.670929] env[65359]: INFO networking_nsxv3.common.synchronization [req-e3c6f0df-a04d-4fed-a6f4-16cea2e71932 req-34b61fd0-746b-4237-8dca-353a63bc619d service nova] Enqueued Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1200.671304] env[65359]: INFO networking_nsxv3.common.synchronization [req-e3c6f0df-a04d-4fed-a6f4-16cea2e71932 req-34b61fd0-746b-4237-8dca-353a63bc619d service nova] Enqueued Resource ID: d9ded336-2c43-431a-ad65-549543b0a0fe with Priority: HIGHEST for action port [ 1200.672098] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_rules [ 1200.672356] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1200.672557] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9ded336-2c43-431a-ad65-549543b0a0fe with Priority: HIGHEST for action port [ 1200.673040] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.673269] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.673677] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.673830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.674166] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9ded336-2c43-431a-ad65-549543b0a0fe taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.674373] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9ded336-2c43-431a-ad65-549543b0a0fe" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.674524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9ded336-2c43-431a-ad65-549543b0a0fe" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.674938] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9ded336-2c43-431a-ad65-549543b0a0fe" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.675133] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9ded336-2c43-431a-ad65-549543b0a0fe',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.819661] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28a192d2-893c-4c78-805e-fa2fb948ce50: rpc.has_security_group_logging(os_id): False [ 1200.838283] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.838514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.838514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.838695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.838788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.839038] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.839143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.839208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.839368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.839447] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.839623] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.839718] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.839781] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.839919] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.839991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.840182] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.840275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.840335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.840473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.840543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.840628] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 is going to be created. [ 1200.903125] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.903299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.903344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.903566] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.903749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.915586] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 in Status: IN_PROGRESS for 2s [ 1201.178305] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9ded336-2c43-431a-ad65-549543b0a0fe with status ACTIVE [ 1201.180234] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.180234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.180234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.180234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.180234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.180234] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.180234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.180234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.180234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.180234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.180234] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.180234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.180234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.180234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.180234] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.180234] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9ded336-2c43-431a-ad65-549543b0a0fe is going to be updated. [ 1201.207682] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.208610] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.208610] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.208754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.208794] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.208986] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9ded336-2c43-431a-ad65-549543b0a0fe" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.247262] env[65359]: INFO networking_nsxv3.common.synchronization [req-18a7022d-ec60-45c7-9e79-3f67b8503c89 req-b263b722-3b84-4bcd-b4c2-a580da8862b7 tempest-ListServerFiltersTestJSON-755616435 tempest-ListServerFiltersTestJSON-755616435-project-member] Enqueued Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1201.247822] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1201.248153] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.248259] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.568944] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-268 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.569164] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.569287] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.569555] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.569807] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.569961] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.570109] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.570285] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.570423] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.570627] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1201.570737] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1201.570850] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1201.570977] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1201.571100] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1201.571206] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1201.571333] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1201.592357] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1201.592664] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1201.593031] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1201.593433] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-268" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.594369] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.594987] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.595177] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.595525] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.595761] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.889151] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: SUCCESS [ 1201.889502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.889541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.889750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.889946] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.890081] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.890151] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.890311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.890392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.890476] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.890574] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.891521] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.891694] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.891851] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.891953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.892027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.892181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.892260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.892329] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.098376] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.098575] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.098673] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.098971] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.099142] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.099297] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port 4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15 not found, creating... [ 1202.099557] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.099714] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.099832] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.100062] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.100198] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.100472] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.100625] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.100741] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.101060] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.101202] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.101339] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: 4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15 is going to be created. [ 1202.126976] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.127206] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.127320] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.127596] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.127822] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.128061] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.394431] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.394601] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.394858] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.871200] env[65359]: INFO networking_nsxv3.common.synchronization [req-18a7022d-ec60-45c7-9e79-3f67b8503c89 req-08532414-bd20-4ce2-847b-07512470c0bb service nova] Enqueued Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_rules [ 1202.871381] env[65359]: INFO networking_nsxv3.common.synchronization [req-18a7022d-ec60-45c7-9e79-3f67b8503c89 req-08532414-bd20-4ce2-847b-07512470c0bb service nova] Enqueued Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1202.871517] env[65359]: INFO networking_nsxv3.common.synchronization [req-18a7022d-ec60-45c7-9e79-3f67b8503c89 req-08532414-bd20-4ce2-847b-07512470c0bb service nova] Enqueued Resource ID: 4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15 with Priority: HIGHEST for action port [ 1202.872137] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_rules [ 1202.872305] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1202.872418] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15 with Priority: HIGHEST for action port [ 1202.872807] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.872923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.873197] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.873327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.873547] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.873689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.873799] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.874259] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.874345] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.896751] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.930162] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 in Status: SUCCESS [ 1202.930510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.376219] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15 with status ACTIVE [ 1203.376691] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.376691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.376691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.376882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.376928] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.377150] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.377267] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.377308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.377482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.377582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.377750] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.377849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.377951] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.378338] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.378338] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.378951] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15 is going to be updated. [ 1203.398498] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.398673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.398729] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.398927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.399023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.399115] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83cd6ed2-10e9-4291-bb94-80714475749a is going to be updated. [ 1203.401129] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.401242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.401308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.401469] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.401592] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.401905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e4cadde-4d0c-46a5-b2f3-f15d6faa5d15" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.429285] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.429416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.429416] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.429607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.429749] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.440254] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: IN_PROGRESS for 2s [ 1205.451547] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: SUCCESS [ 1205.451905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.451953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.452200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.452389] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.452508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.452575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.452761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.452843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.452942] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.954806] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.457168] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.960298] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.961104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.961104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.961104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.961104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.961104] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83cd6ed2-10e9-4291-bb94-80714475749a is going to be updated. [ 1206.997266] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.997530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.997530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.997695] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.997844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.008473] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: IN_PROGRESS for 2s [ 1207.873570] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1207.873570] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1209.022631] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: SUCCESS [ 1209.022631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.022631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.022631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.022631] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.022631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.022631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.022631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.022631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.022631] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.525987] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.031622] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.534854] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.535316] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.535489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.535817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.535976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.536195] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83cd6ed2-10e9-4291-bb94-80714475749a is going to be updated. [ 1210.581517] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.581844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.581844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.582173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.582499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.597936] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: IN_PROGRESS for 2s [ 1211.929641] env[65359]: INFO networking_nsxv3.common.synchronization [req-33061919-8c7b-4d67-8dec-0dd3d4ab61d6 req-6c6139da-3aea-49db-87dc-8223e706dad7 tempest-ServersTestFqdnHostnames-1212627849 tempest-ServersTestFqdnHostnames-1212627849-project-member] Enqueued Resource ID: 8f60147d-b931-488d-876e-01830746f0e5 with Priority: HIGHEST for action security_group_members [ 1211.930859] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f60147d-b931-488d-876e-01830746f0e5 with Priority: HIGHEST for action security_group_members [ 1211.931979] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f60147d-b931-488d-876e-01830746f0e5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.931979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.931979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.931979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.931979] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.931979] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.932303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.932303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.932379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.932489] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f60147d-b931-488d-876e-01830746f0e5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.436141] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.436392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.436460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.436723] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.436863] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.437173] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.437327] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.437421] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.437647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.437759] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.437888] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f60147d-b931-488d-876e-01830746f0e5 is going to be updated. [ 1212.475035] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.475270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.475270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.475511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.475685] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.487326] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f60147d-b931-488d-876e-01830746f0e5 in Status: IN_PROGRESS for 2s [ 1212.614073] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: SUCCESS [ 1212.614383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.614609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.614858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.616704] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.616704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.616704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.616704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.616704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.616704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.616704] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.616704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.616704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.616704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.616704] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.616704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.617971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.617971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.617971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.617971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.617971] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.618462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.618660] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.619723] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.620307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.620549] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.620873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.621043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.621234] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.123446] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83cd6ed2-10e9-4291-bb94-80714475749a: rpc.has_security_group_logging(os_id): False [ 1213.126627] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.145108] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.145306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.145439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.145776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.145886] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.146244] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.146405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.146507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.146760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.146894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.147206] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.147359] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.148041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.148041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.148041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.148267] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.148267] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.148426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.148580] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.148706] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.148823] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83cd6ed2-10e9-4291-bb94-80714475749a is going to be created. [ 1213.212564] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.212564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.212564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.212933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.213187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.227528] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: IN_PROGRESS for 2s [ 1213.628941] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.132101] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.132514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.132514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.132613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.132646] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.132743] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83cd6ed2-10e9-4291-bb94-80714475749a is going to be updated. [ 1214.167969] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.168256] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.168318] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.168600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.169365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.177938] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: IN_PROGRESS for 2s [ 1214.498182] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f60147d-b931-488d-876e-01830746f0e5 in Status: SUCCESS [ 1214.498440] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f60147d-b931-488d-876e-01830746f0e5 deletion is rescheduled due to dependency. [ 1214.498533] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f60147d-b931-488d-876e-01830746f0e5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.243101] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: SUCCESS [ 1215.243494] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.243635] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.243950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.244104] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.747516] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.747516] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.188540] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: SUCCESS [ 1216.188763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.188926] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.189176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.189370] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.189492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.189561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.189714] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.189795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.189882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.189996] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.695985] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.695985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.695985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.695985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.695985] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.695985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.695985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.695985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.695985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.695985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.695985] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.695985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.695985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.695985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.695985] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.695985] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.696929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.696929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.696929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.696929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.696929] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.932498] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1216.932498] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1217.202683] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83cd6ed2-10e9-4291-bb94-80714475749a: rpc.has_security_group_logging(os_id): False [ 1217.220791] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.220984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.221066] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.221242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.221333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.222171] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.222171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.222171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.222171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.222171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.222171] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.222618] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.222693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.222888] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.222983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.223226] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.223628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.223628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.223628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.223628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.223768] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83cd6ed2-10e9-4291-bb94-80714475749a is going to be updated. [ 1217.296920] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.297637] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.297637] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.297637] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.297637] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.315317] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: IN_PROGRESS for 2s [ 1219.331178] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: SUCCESS [ 1219.331548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.331976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.332246] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.332341] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.834677] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.834834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.834982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.835298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.835367] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.835448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.835503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.835656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.835740] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.835829] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.835971] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.337959] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.338280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.338280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.338355] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.338567] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.338763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.338763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.339181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.339181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.339181] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.339181] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.339393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.339393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.339460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.339538] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.339656] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.339708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.339854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.339914] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.339997] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.340189] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.843553] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83cd6ed2-10e9-4291-bb94-80714475749a: rpc.has_security_group_logging(os_id): False [ 1220.861595] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.861854] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.861919] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.862153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.862257] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.862493] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.862653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.862725] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.862927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.863020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.863209] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.863322] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.863435] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.863619] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.863743] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.863987] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.864104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.864414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.864414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.864551] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.864551] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83cd6ed2-10e9-4291-bb94-80714475749a is going to be updated. [ 1220.924301] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.924584] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.924710] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.925105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.925247] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.941252] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: IN_PROGRESS for 2s [ 1221.933819] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1221.933819] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1222.248210] env[65359]: INFO networking_nsxv3.common.synchronization [req-fd625b33-25f2-448a-a852-694d4a8dd921 req-2b5382ef-1930-4dc2-a54b-137415264a3a tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_members [ 1222.248210] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_members [ 1222.249034] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.249034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.249034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.249034] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.249328] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.249420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.249524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.249774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.249925] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.250104] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.752575] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.752790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.752790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.753111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.753187] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.753487] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.753642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.753738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.753981] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.754061] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.754128] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 is going to be updated. [ 1222.813341] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.813532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.813574] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.813767] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.813991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.835147] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 in Status: IN_PROGRESS for 2s [ 1222.960047] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: SUCCESS [ 1222.960307] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.848182] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 in Status: SUCCESS [ 1224.848544] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 deletion is rescheduled due to dependency. [ 1224.848584] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.835794] env[65359]: INFO networking_nsxv3.common.synchronization [req-0da2f6db-b6ca-457d-b151-ff7d1cb64e28 req-9c3d890a-4c9e-4378-9145-0f8f2992bb88 tempest-ListServerFiltersTestJSON-755616435 tempest-ListServerFiltersTestJSON-755616435-project-member] Enqueued Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1226.836397] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1226.836712] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.836834] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.836902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.837139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.837363] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.837459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.837496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.837655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.837780] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.837839] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.340075] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.842614] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.344764] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.345088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.345088] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.346065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.346065] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.346065] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83cd6ed2-10e9-4291-bb94-80714475749a is going to be updated. [ 1228.380930] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.381219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.381219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.381406] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.381565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.394296] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: IN_PROGRESS for 2s [ 1230.406788] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: SUCCESS [ 1230.407134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.834434] env[65359]: INFO networking_nsxv3.common.synchronization [None req-f261aaf5-935c-4df9-bfbc-915e6542435c tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc with Priority: HIGHEST for action security_group_rules [ 1230.834863] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc with Priority: HIGHEST for action security_group_rules [ 1230.835214] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.835338] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.835417] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.835704] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.835824] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19016fc0-c721-4fe7-a048-5f4ea75fecfc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.911375] env[65359]: INFO networking_nsxv3.common.synchronization [None req-612af8e9-1823-402e-bd04-20fb1790d2ec tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc with Priority: HIGHEST for action security_group_rules [ 1230.912027] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc with Priority: HIGHEST for action security_group_rules [ 1230.912342] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.912445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.354874] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.355112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.355186] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.355395] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.355486] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.355581] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc already deleted. [ 1231.355665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.355811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.355977] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.356076] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19016fc0-c721-4fe7-a048-5f4ea75fecfc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.879958] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.880320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.880320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.880536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.880650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.880776] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc already deleted. [ 1231.880883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.727674] env[65359]: INFO networking_nsxv3.common.synchronization [req-665916df-0cab-4453-9c75-176c4cabe40d req-fed5e0e2-79fb-46dd-900a-b4f804daf5b4 tempest-ListServerFiltersTestJSON-755616435 tempest-ListServerFiltersTestJSON-755616435-project-member] Enqueued Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1234.728486] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1234.728665] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.728853] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.728927] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.729183] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.729400] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.729544] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.729630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.729816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.729924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.730053] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.232660] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.735175] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.238325] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.238503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.238581] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.238812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.238908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.239014] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83cd6ed2-10e9-4291-bb94-80714475749a is going to be updated. [ 1236.270443] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.270676] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.270676] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.270934] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.271043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.280319] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: IN_PROGRESS for 2s [ 1236.470677] env[65359]: INFO networking_nsxv3.common.synchronization [req-be2e6396-7af5-479c-ae48-f9c4a5ecbc5a req-dae0e0e4-1954-4fbe-9e4f-17788f48084e tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc with Priority: HIGHEST for action security_group_members [ 1236.471192] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc with Priority: HIGHEST for action security_group_members [ 1236.472043] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-19016fc0-c721-4fe7-a048-5f4ea75fecfc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.472043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.472043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.472043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.472043] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.472368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.472368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.472368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.472454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.473038] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19016fc0-c721-4fe7-a048-5f4ea75fecfc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.651048] env[65359]: INFO networking_nsxv3.common.synchronization [req-9439c0b8-fd1f-4554-b889-fc74e50aac38 req-1d88a1f8-0c57-4023-a4b3-e7f8117a67f7 tempest-ServerActionsTestJSON-975876043 tempest-ServerActionsTestJSON-975876043-project-member] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 1236.651612] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 1236.651919] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.652423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.652530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.652716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.652882] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.653020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.653103] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.653258] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.653369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.653469] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.891843] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-854 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.891843] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.891843] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.892710] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.892710] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.892710] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.892710] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.892871] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.892919] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.893176] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1236.893242] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1236.893350] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1236.893461] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1236.893566] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1236.893704] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1236.893839] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1236.912847] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1236.913271] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1236.913697] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1236.913697] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.914080] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-a2eabd5e-678d-4054-ab27-d42cd9c29b11 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.914289] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-a2eabd5e-678d-4054-ab27-d42cd9c29b11" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.914434] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-a2eabd5e-678d-4054-ab27-d42cd9c29b11" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.914812] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-a2eabd5e-678d-4054-ab27-d42cd9c29b11" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.915082] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2eabd5e-678d-4054-ab27-d42cd9c29b11',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.976033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.976033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.976229] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.977158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.977158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.977158] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.977158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.977158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.977158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.977158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.977158] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc already deleted. [ 1236.977158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.156092] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.156379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.156379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.156669] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.156959] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.157108] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.157286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.157374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.157594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.157730] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.157838] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 is going to be updated. [ 1237.186290] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.186496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.186496] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.186689] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.186826] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.195909] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: IN_PROGRESS for 2s [ 1237.418295] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.418295] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.418542] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.418739] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.418806] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.418958] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port a2eabd5e-678d-4054-ab27-d42cd9c29b11 not found, creating... [ 1237.419234] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.419389] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.419506] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.419716] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.419850] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.420163] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.420318] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.420434] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.420651] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.420757] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.420893] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: a2eabd5e-678d-4054-ab27-d42cd9c29b11 is going to be created. [ 1237.443504] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.443742] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.443742] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.443995] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.444194] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.444422] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-a2eabd5e-678d-4054-ab27-d42cd9c29b11" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.183081] env[65359]: INFO networking_nsxv3.common.synchronization [req-be2e6396-7af5-479c-ae48-f9c4a5ecbc5a req-3e93c401-4c67-4ada-be2a-ddb8334d1947 service nova] Enqueued Resource ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc with Priority: HIGHEST for action security_group_rules [ 1238.183570] env[65359]: INFO networking_nsxv3.common.synchronization [req-be2e6396-7af5-479c-ae48-f9c4a5ecbc5a req-3e93c401-4c67-4ada-be2a-ddb8334d1947 service nova] Enqueued Resource ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc with Priority: HIGHEST for action security_group_members [ 1238.183570] env[65359]: INFO networking_nsxv3.common.synchronization [req-be2e6396-7af5-479c-ae48-f9c4a5ecbc5a req-3e93c401-4c67-4ada-be2a-ddb8334d1947 service nova] Enqueued Resource ID: a2eabd5e-678d-4054-ab27-d42cd9c29b11 with Priority: HIGHEST for action port [ 1238.184057] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc with Priority: HIGHEST for action security_group_rules [ 1238.184223] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc with Priority: HIGHEST for action security_group_members [ 1238.184325] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2eabd5e-678d-4054-ab27-d42cd9c29b11 with Priority: HIGHEST for action port [ 1238.184625] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.184754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.184845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.185120] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.186035] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19016fc0-c721-4fe7-a048-5f4ea75fecfc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.186400] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-19016fc0-c721-4fe7-a048-5f4ea75fecfc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.186489] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.187147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.187147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.187147] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.187147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.187469] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.187469] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.187578] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.188273] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19016fc0-c721-4fe7-a048-5f4ea75fecfc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.193493] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2eabd5e-678d-4054-ab27-d42cd9c29b11 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.193709] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2eabd5e-678d-4054-ab27-d42cd9c29b11" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.193801] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2eabd5e-678d-4054-ab27-d42cd9c29b11" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.193960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2eabd5e-678d-4054-ab27-d42cd9c29b11" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.194062] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2eabd5e-678d-4054-ab27-d42cd9c29b11',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.294077] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: SUCCESS [ 1238.294344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.696481] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19016fc0-c721-4fe7-a048-5f4ea75fecfc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.697562] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-19016fc0-c721-4fe7-a048-5f4ea75fecfc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.697716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.697833] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2eabd5e-678d-4054-ab27-d42cd9c29b11 with status ACTIVE [ 1238.697992] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.698119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.698190] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.698530] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.698641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.698796] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.698887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.698940] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.699127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.699204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.699444] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.699565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.699622] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.699754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.699822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.699907] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2eabd5e-678d-4054-ab27-d42cd9c29b11 is going to be updated. [ 1238.724171] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.724423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.724423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.724631] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.724782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.724998] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2eabd5e-678d-4054-ab27-d42cd9c29b11" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.201842] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19016fc0-c721-4fe7-a048-5f4ea75fecfc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.206420] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: SUCCESS [ 1239.206602] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 deletion is rescheduled due to dependency. [ 1239.206717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.664052] env[65359]: INFO networking_nsxv3.common.synchronization [req-6df2317c-b2a3-4ac5-87b1-81f8f26ac61d req-763dae24-24fb-42d6-a37d-e58ef4f7ec4f tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 with Priority: HIGHEST for action security_group_members [ 1239.664638] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 with Priority: HIGHEST for action security_group_members [ 1239.664974] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-71e93a62-f682-47ff-92e4-1f8bd5455449 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.665975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.665975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.665975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.665975] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.666506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.666506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.666506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.666506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.666506] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71e93a62-f682-47ff-92e4-1f8bd5455449',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.703815] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.703973] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.704059] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.704272] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.704364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.704466] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc is going to be created. [ 1239.737136] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.737370] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.737422] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.737630] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.737790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.749020] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc in Status: UNINITIALIZED for 2s [ 1240.171791] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.171791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.171791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.172075] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.172107] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.172358] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.172482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.172551] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.172720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.172799] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.172954] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 is going to be updated. [ 1240.202957] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.203398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.203398] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.203527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.203581] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.214662] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 in Status: IN_PROGRESS for 2s [ 1240.889297] env[65359]: INFO networking_nsxv3.common.synchronization [req-b7576a35-8fc4-4873-9f27-1d79a768fdbb req-5ac6526a-1f2c-46b6-b8e2-0526559ff82c tempest-ListServerFiltersTestJSON-755616435 tempest-ListServerFiltersTestJSON-755616435-project-member] Enqueued Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1240.890061] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGHEST for action security_group_members [ 1240.890186] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.890288] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.890342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.890524] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.890672] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.891142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.891211] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.891369] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.891457] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.891555] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.394067] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.394067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.394067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.394067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.394552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.394552] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.394552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.394552] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.394736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.394736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.394736] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83cd6ed2-10e9-4291-bb94-80714475749a is going to be updated. [ 1241.421706] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.421900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.421900] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.422134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.422279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.431888] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: IN_PROGRESS for 2s [ 1241.759040] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc in Status: SUCCESS [ 1241.759293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.759434] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.759643] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.759837] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.759958] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.760040] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.760199] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.760280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.760365] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.760460] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19016fc0-c721-4fe7-a048-5f4ea75fecfc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.956336] env[65359]: INFO networking_nsxv3.common.synchronization [req-195659a9-751a-4a4c-9409-2e408e66486d req-8dde043c-b253-48b8-b7d6-e7e0e9802b56 tempest-ServerActionsTestOtherB-968321773 tempest-ServerActionsTestOtherB-968321773-project-member] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1241.956866] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1241.957642] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.957642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.957642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.957642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.957807] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.957807] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.958490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.958490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.958490] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.958490] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.225042] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 in Status: SUCCESS [ 1242.225309] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71e93a62-f682-47ff-92e4-1f8bd5455449 deletion is rescheduled due to dependency. [ 1242.225464] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71e93a62-f682-47ff-92e4-1f8bd5455449" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.265510] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19016fc0-c721-4fe7-a048-5f4ea75fecfc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.461155] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.461155] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.461155] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.461687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.461687] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.461687] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.461846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.461846] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.462019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.462087] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.462182] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 is going to be updated. [ 1242.493274] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.493498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.493548] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.493792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.494063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.504336] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: IN_PROGRESS for 2s [ 1242.768163] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19016fc0-c721-4fe7-a048-5f4ea75fecfc: rpc.has_security_group_logging(os_id): False [ 1242.795380] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.795608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.795608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.795918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.796020] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.796278] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.796376] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.796442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.796598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.797028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.797028] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc is going to be created. [ 1242.882696] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.882847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.882997] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.883903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.883903] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.898834] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc in Status: IN_PROGRESS for 2s [ 1243.441531] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83cd6ed2-10e9-4291-bb94-80714475749a in Status: SUCCESS [ 1243.442270] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83cd6ed2-10e9-4291-bb94-80714475749a deletion is rescheduled due to dependency. [ 1243.442270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.112841] env[65359]: INFO networking_nsxv3.common.synchronization [req-b562dcd9-aa1c-49f2-8907-a83048ba2b59 req-9c02971d-4869-484c-9eb9-36b3b48c7ba5 tempest-ServerActionsTestJSON-975876043 tempest-ServerActionsTestJSON-975876043-project-member] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 1244.113221] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 1244.114796] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.114796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.114796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.114796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.114796] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.114796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.114796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.114796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.114796] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.114796] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.414787] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-227 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.414992] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.415163] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.415429] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.415681] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.415833] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.415946] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.416178] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.416367] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.416710] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1244.416786] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1244.416885] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1244.416987] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1244.417109] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1244.417215] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1244.417345] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1244.438076] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1244.438279] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1244.438369] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1244.438611] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-227" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.438980] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-26674770-d615-4feb-b40f-b3e043f90360 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.439220] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-26674770-d615-4feb-b40f-b3e043f90360" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.439385] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-26674770-d615-4feb-b40f-b3e043f90360" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.439755] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-26674770-d615-4feb-b40f-b3e043f90360" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.439939] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26674770-d615-4feb-b40f-b3e043f90360',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.514607] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: SUCCESS [ 1244.514811] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 deletion is rescheduled due to dependency. [ 1244.514967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.617950] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.617950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.617950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.617950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.617950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.618563] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.618563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.618563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.618761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.618761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.618761] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 is going to be updated. [ 1244.654706] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.654964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.654964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.655230] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.655385] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.666121] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: IN_PROGRESS for 2s [ 1244.911403] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc in Status: SUCCESS [ 1244.911403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.942964] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.943264] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.943354] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.943646] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.943800] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.943965] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 26674770-d615-4feb-b40f-b3e043f90360 not found, creating... [ 1244.944266] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.944427] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.944546] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.944773] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.944911] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.945305] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.945465] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.945623] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.945792] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.945921] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.946090] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 26674770-d615-4feb-b40f-b3e043f90360 is going to be created. [ 1244.965235] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.965500] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.965597] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.965864] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.966207] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.966445] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-26674770-d615-4feb-b40f-b3e043f90360" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.675625] env[65359]: INFO networking_nsxv3.common.synchronization [req-b562dcd9-aa1c-49f2-8907-a83048ba2b59 req-08d4738e-97e0-472a-bd91-85773997bc67 service nova] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_rules [ 1245.675882] env[65359]: INFO networking_nsxv3.common.synchronization [req-b562dcd9-aa1c-49f2-8907-a83048ba2b59 req-08d4738e-97e0-472a-bd91-85773997bc67 service nova] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 1245.675978] env[65359]: INFO networking_nsxv3.common.synchronization [req-b562dcd9-aa1c-49f2-8907-a83048ba2b59 req-08d4738e-97e0-472a-bd91-85773997bc67 service nova] Enqueued Resource ID: 26674770-d615-4feb-b40f-b3e043f90360 with Priority: HIGHEST for action port [ 1245.676474] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_rules [ 1245.677243] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 1245.677412] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26674770-d615-4feb-b40f-b3e043f90360 with Priority: HIGHEST for action port [ 1245.677701] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.677827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.677897] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.678105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.678191] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.679552] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.679657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.679852] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-26674770-d615-4feb-b40f-b3e043f90360 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.680047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26674770-d615-4feb-b40f-b3e043f90360" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.680047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26674770-d615-4feb-b40f-b3e043f90360" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.680197] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26674770-d615-4feb-b40f-b3e043f90360" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.680271] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26674770-d615-4feb-b40f-b3e043f90360',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.180621] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.180764] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.183181] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26674770-d615-4feb-b40f-b3e043f90360 with status ACTIVE [ 1246.183443] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.183600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.183600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.183776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.183868] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.184054] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.184156] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.184219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.184379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.184458] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.184636] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.184728] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.184790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.184929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.185010] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.185127] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26674770-d615-4feb-b40f-b3e043f90360 is going to be updated. [ 1246.209648] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.209898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.209955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.210213] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.210392] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.210597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26674770-d615-4feb-b40f-b3e043f90360" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.571801] env[65359]: INFO networking_nsxv3.common.synchronization [None req-9b263bb6-1890-419f-9572-4964cc29794c tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: eabb3370-dfe1-4663-be08-bc9370ee3284 with Priority: HIGHEST for action security_group_rules [ 1246.572361] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eabb3370-dfe1-4663-be08-bc9370ee3284 with Priority: HIGHEST for action security_group_rules [ 1246.572653] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eabb3370-dfe1-4663-be08-bc9370ee3284 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.572771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.572838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.573214] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.573315] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eabb3370-dfe1-4663-be08-bc9370ee3284',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.645320] env[65359]: INFO networking_nsxv3.common.synchronization [None req-102e7f10-a541-4a9c-8bf3-bdc1dc06e1f0 tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: eabb3370-dfe1-4663-be08-bc9370ee3284 with Priority: HIGHEST for action security_group_rules [ 1246.645576] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eabb3370-dfe1-4663-be08-bc9370ee3284 with Priority: HIGHEST for action security_group_rules [ 1246.645899] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eabb3370-dfe1-4663-be08-bc9370ee3284 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.646019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.677173] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: SUCCESS [ 1246.677872] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 deletion is rescheduled due to dependency. [ 1246.678598] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.679691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.679870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.680074] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.680228] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.680353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.680562] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.680671] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.680797] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.093708] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.093861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.093922] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.094176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.094267] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.094372] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eabb3370-dfe1-4663-be08-bc9370ee3284 already deleted. [ 1247.094450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.094604] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.094764] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.094870] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eabb3370-dfe1-4663-be08-bc9370ee3284',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.183496] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.616231] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.616445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.616495] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.617357] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.617493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.617724] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eabb3370-dfe1-4663-be08-bc9370ee3284 already deleted. [ 1247.617724] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.685977] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.188841] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.189064] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.189165] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.189446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.189567] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.189702] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 is going to be updated. [ 1248.220044] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.220261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.220261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.220458] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.220599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.230192] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: IN_PROGRESS for 2s [ 1250.241748] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: SUCCESS [ 1250.242073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.242171] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.242375] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.242588] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.242735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.242788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.242976] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.243068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.243175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.243279] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.745945] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.249381] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3577cfc-adec-4c56-bc24-6acdb8887663: rpc.has_security_group_logging(os_id): False [ 1251.268582] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.268736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.268782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.269374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.269374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.269374] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.269584] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.269584] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.269654] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.269738] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.269828] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 is going to be updated. [ 1251.328181] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.328390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.328450] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.328650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.328828] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.342307] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: IN_PROGRESS for 2s [ 1251.646388] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1251.646638] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1252.103188] env[65359]: INFO networking_nsxv3.common.synchronization [req-2869cd6a-db80-47f9-b5d2-b46ffbe237bf req-4a2787ba-eb42-4b7e-8c15-0bd7557094a1 tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: eabb3370-dfe1-4663-be08-bc9370ee3284 with Priority: HIGHEST for action security_group_members [ 1252.103738] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eabb3370-dfe1-4663-be08-bc9370ee3284 with Priority: HIGHEST for action security_group_members [ 1252.104368] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-eabb3370-dfe1-4663-be08-bc9370ee3284 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.104602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.104752] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.105139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.105373] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.105508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.105585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.105823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.105952] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.106148] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eabb3370-dfe1-4663-be08-bc9370ee3284',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.407181] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.407539] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.407539] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.407854] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.408165] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.408364] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.408511] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.408764] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.408941] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.409208] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1252.409355] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1252.409511] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1252.409650] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1252.409798] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1252.409899] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1252.410077] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1252.429434] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1252.429630] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1252.429772] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1252.429945] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-418" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.430276] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-4d8318f5-7d00-42a1-9fb3-29134d7fb1bc taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.430463] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-4d8318f5-7d00-42a1-9fb3-29134d7fb1bc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.430582] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-4d8318f5-7d00-42a1-9fb3-29134d7fb1bc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.430918] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-4d8318f5-7d00-42a1-9fb3-29134d7fb1bc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.431068] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d8318f5-7d00-42a1-9fb3-29134d7fb1bc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.608334] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.608560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.608560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.608785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.608878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.609099] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.609205] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.609270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.609428] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.609506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.609594] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eabb3370-dfe1-4663-be08-bc9370ee3284 already deleted. [ 1252.609680] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.933712] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.934809] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.934809] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.934809] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.934809] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.934809] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 4d8318f5-7d00-42a1-9fb3-29134d7fb1bc not found, creating... [ 1252.935057] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.935250] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.935250] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.935434] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.936052] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.936052] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.936052] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.936253] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.938189] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.938427] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.938608] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 4d8318f5-7d00-42a1-9fb3-29134d7fb1bc is going to be created. [ 1252.962501] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.962724] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.962929] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.963275] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.963569] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.963829] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-4d8318f5-7d00-42a1-9fb3-29134d7fb1bc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.359429] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: SUCCESS [ 1253.359429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.685964] env[65359]: INFO networking_nsxv3.common.synchronization [req-2869cd6a-db80-47f9-b5d2-b46ffbe237bf req-a88017f5-4813-498f-baad-c632ff4c0aa0 service nova] Enqueued Resource ID: eabb3370-dfe1-4663-be08-bc9370ee3284 with Priority: HIGHEST for action security_group_rules [ 1253.686239] env[65359]: INFO networking_nsxv3.common.synchronization [req-2869cd6a-db80-47f9-b5d2-b46ffbe237bf req-a88017f5-4813-498f-baad-c632ff4c0aa0 service nova] Enqueued Resource ID: eabb3370-dfe1-4663-be08-bc9370ee3284 with Priority: HIGHEST for action security_group_members [ 1253.686344] env[65359]: INFO networking_nsxv3.common.synchronization [req-2869cd6a-db80-47f9-b5d2-b46ffbe237bf req-a88017f5-4813-498f-baad-c632ff4c0aa0 service nova] Enqueued Resource ID: 4d8318f5-7d00-42a1-9fb3-29134d7fb1bc with Priority: HIGHEST for action port [ 1253.686858] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eabb3370-dfe1-4663-be08-bc9370ee3284 with Priority: HIGHEST for action security_group_rules [ 1253.687008] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eabb3370-dfe1-4663-be08-bc9370ee3284 with Priority: HIGHEST for action security_group_members [ 1253.687126] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d8318f5-7d00-42a1-9fb3-29134d7fb1bc with Priority: HIGHEST for action port [ 1253.687479] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eabb3370-dfe1-4663-be08-bc9370ee3284 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.687549] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.687594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.687810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.687902] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eabb3370-dfe1-4663-be08-bc9370ee3284',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.688696] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-eabb3370-dfe1-4663-be08-bc9370ee3284 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.688802] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.688878] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.689042] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.689185] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.689282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.689343] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.689502] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.690477] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.690621] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eabb3370-dfe1-4663-be08-bc9370ee3284',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.691434] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d8318f5-7d00-42a1-9fb3-29134d7fb1bc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.691550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d8318f5-7d00-42a1-9fb3-29134d7fb1bc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.691636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d8318f5-7d00-42a1-9fb3-29134d7fb1bc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.691797] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d8318f5-7d00-42a1-9fb3-29134d7fb1bc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.691873] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d8318f5-7d00-42a1-9fb3-29134d7fb1bc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.193948] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eabb3370-dfe1-4663-be08-bc9370ee3284',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.195424] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-eabb3370-dfe1-4663-be08-bc9370ee3284 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.195424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.195721] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d8318f5-7d00-42a1-9fb3-29134d7fb1bc with status ACTIVE [ 1254.195721] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.195858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.195858] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.196012] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.196114] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.196307] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.196423] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.196843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.196843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.196843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.196942] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.196990] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.197732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.197918] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.198031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.198115] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d8318f5-7d00-42a1-9fb3-29134d7fb1bc is going to be updated. [ 1254.219375] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.219527] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.219585] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.219778] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.219910] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.220080] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d8318f5-7d00-42a1-9fb3-29134d7fb1bc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.267542] env[65359]: INFO networking_nsxv3.common.synchronization [req-df675bf5-3d62-4ac8-a257-5cf4a2a70336 req-3535f6a0-5a06-4ac7-800b-9cce3da662ca tempest-ServerActionsTestOtherB-968321773 tempest-ServerActionsTestOtherB-968321773-project-member] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1254.268089] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1254.268428] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.268564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.268634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.268832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.269113] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.269311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.269364] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.269537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.269651] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.269766] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.511242] env[65359]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1254.511394] env[65359]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1254.595305] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-400 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.595521] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.595658] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.596014] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.596238] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.596534] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.596534] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.596736] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.596885] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.597119] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1254.597248] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1254.597359] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1254.597473] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1254.597583] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1254.597687] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1254.597829] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1254.617209] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1254.617479] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1254.617768] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1254.618019] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.618424] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.618647] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.618812] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.619200] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.619350] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.700933] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eabb3370-dfe1-4663-be08-bc9370ee3284',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.772109] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.772342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.772446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.772633] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.772731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.772942] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.773085] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.773153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.773313] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.773429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.773526] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 is going to be updated. [ 1254.809565] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.809792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.809792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.809988] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.810160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.821015] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: IN_PROGRESS for 2s [ 1255.122788] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.123143] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.123358] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.123754] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.123984] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.124243] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f not found, creating... [ 1255.124658] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.124900] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.125103] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.125492] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.125711] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.126164] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.126402] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.126581] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.126893] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.127122] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.127345] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f is going to be created. [ 1255.147110] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.147348] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.147471] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.147822] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.147970] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.148209] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.203523] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.203761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.203761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.203942] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.204054] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.204166] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eabb3370-dfe1-4663-be08-bc9370ee3284 is going to be created. [ 1255.232151] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.232449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.232449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.232582] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.232717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.247223] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eabb3370-dfe1-4663-be08-bc9370ee3284 in Status: UNINITIALIZED for 2s [ 1255.852212] env[65359]: INFO networking_nsxv3.common.synchronization [req-df675bf5-3d62-4ac8-a257-5cf4a2a70336 req-94c252fc-d74f-4616-86f4-6252ea76c00a service nova] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_rules [ 1255.852565] env[65359]: INFO networking_nsxv3.common.synchronization [req-df675bf5-3d62-4ac8-a257-5cf4a2a70336 req-94c252fc-d74f-4616-86f4-6252ea76c00a service nova] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1255.852724] env[65359]: INFO networking_nsxv3.common.synchronization [req-df675bf5-3d62-4ac8-a257-5cf4a2a70336 req-94c252fc-d74f-4616-86f4-6252ea76c00a service nova] Enqueued Resource ID: 2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f with Priority: HIGHEST for action port [ 1255.853294] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_rules [ 1255.853431] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1255.853527] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f with Priority: HIGHEST for action port [ 1255.853819] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.853978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.854071] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.854276] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.854364] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.855781] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.855921] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.856143] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.856244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.856298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.856608] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.856701] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.358843] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.358843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.358843] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f with status ACTIVE [ 1256.358843] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.358843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.359204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.359204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.359275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.359447] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.359549] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.359612] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.359769] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.359847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.360039] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.360137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.360202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.360340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.360414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.360497] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f is going to be updated. [ 1256.381262] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.381437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.381481] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.381646] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.381776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.381930] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.830291] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: SUCCESS [ 1256.830443] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 deletion is rescheduled due to dependency. [ 1256.830565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.830728] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.830939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.831139] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.831286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.831390] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.831528] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.831597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.831656] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.257972] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eabb3370-dfe1-4663-be08-bc9370ee3284 in Status: SUCCESS [ 1257.258411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.258411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.258497] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.258698] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.258821] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.258887] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.259079] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.259170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.259258] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.259349] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eabb3370-dfe1-4663-be08-bc9370ee3284',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.334046] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.762350] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eabb3370-dfe1-4663-be08-bc9370ee3284',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.836183] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.265243] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eabb3370-dfe1-4663-be08-bc9370ee3284: rpc.has_security_group_logging(os_id): False [ 1258.283049] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.283215] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.283298] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.283499] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.283591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.283820] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.283921] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.283983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.284149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.284238] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.284350] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eabb3370-dfe1-4663-be08-bc9370ee3284 is going to be created. [ 1258.339579] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.339798] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.339896] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.340206] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.340320] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.340463] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 is going to be updated. [ 1258.346844] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.347038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.347038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.347207] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.347377] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.362808] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eabb3370-dfe1-4663-be08-bc9370ee3284 in Status: IN_PROGRESS for 2s [ 1258.378626] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.378776] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.378848] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.379068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.379212] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.388347] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: IN_PROGRESS for 2s [ 1260.381112] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eabb3370-dfe1-4663-be08-bc9370ee3284 in Status: SUCCESS [ 1260.381500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.399517] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: SUCCESS [ 1260.399839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.400086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.400387] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.400655] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.400833] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.400932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.401175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.401303] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.401433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.401576] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.854869] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1260.855028] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1260.904646] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.407698] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93f7f41b-56ed-4593-aafe-31057cf7c6f5: rpc.has_security_group_logging(os_id): False [ 1261.425935] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.426219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.426219] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.426575] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.426699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.426954] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.427097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.427170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.427336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.427522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.427644] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 is going to be updated. [ 1261.493572] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.493825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.493825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.494031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.494208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.510721] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: IN_PROGRESS for 2s [ 1263.526231] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: SUCCESS [ 1263.526640] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.856309] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1265.856725] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1270.857433] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.857820] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1275.859063] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.859498] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1280.859778] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1280.860195] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1285.861067] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1285.861467] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1290.862626] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1290.862626] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1295.864150] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.864603] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1300.865937] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1300.866345] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1302.469488] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.469991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.469991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.469991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.470147] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.972792] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.475622] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.978193] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1303.978327] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1304.844691] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.845048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.845048] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.845193] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.857916] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1304.858556] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.859839] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1304.916322] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.916510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.916616] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.916897] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.938653] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.938653] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1304.938653] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1304.938653] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1304.993935] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.994192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.994244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.994510] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.996078] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.996267] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1305.094340] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.094451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.094543] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.094712] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.095143] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.095569] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1305.186577] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.186815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.186815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.187049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.187381] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.187728] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 1305.187825] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'eabb3370-dfe1-4663-be08-bc9370ee3284', '6599e228-9d5e-4d59-9a87-ffa7ce620eb9', '28a192d2-893c-4c78-805e-fa2fb948ce50', '588bed60-cf0f-4c53-9608-288d006dd2be', '19016fc0-c721-4fe7-a048-5f4ea75fecfc', 'c4dca704-f8c2-494f-bbf6-802020c49b4b', 'a0a461a8-ce41-468d-b9bb-19fef2690b98', '2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3', 'd3577cfc-adec-4c56-bc24-6acdb8887663', 'd6b655ed-9de5-4842-96d3-3652c9e45ddb', 'c69a6fc7-9355-4fca-ac8f-5d59227f6c2e', 'fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c', '07f94052-66b8-4ea9-9b43-7b740cc698df', 'cfb52c5b-5242-481b-b676-5b24fc2c97d8', 'c4a73e88-8afb-4866-a66b-2583f493db5e', '505f1bca-748c-4f56-9f01-2a595d335a84', '28737c44-388f-4cb8-9cac-0181cbb28981', '1bf93232-d104-4fc5-a8d6-ea22dbf41b58', '83cd6ed2-10e9-4291-bb94-80714475749a', '9eb6909a-01a5-44eb-b7ac-9d4770a02fb6', 'f713e30a-d102-48fb-9e09-3c3ec7abbc99', 'e88dc066-ae5f-45ff-a0ca-c16383ec5af9', '8c01e6ff-b831-4d21-8c9a-e3a067190d76', 'b3ad5eee-fcee-4fc4-8d7b-88d0dddc1685', '93f7f41b-56ed-4593-aafe-31057cf7c6f5', 'e87bd638-a489-4449-9e26-acf0926c56dc', '1bbf694f-ad41-4969-a7b8-1248ccdf3fa1', 'b1f01646-6e50-4a59-a98b-3f8bba190b64', '1d7b1c61-3e92-4ac1-82a4-572363e1e5a5', '316dc9d7-17d3-414d-ba0c-8e1fd143cf19', 'a31844aa-4ad6-4249-8902-93e89324b0b5', 'c053aa73-c45e-4ff7-9c78-5faef3e76294', '8f94b344-4b21-4fd0-9c3a-2488e3e7e504', '582cfc14-9eeb-4704-a95a-052a5b40435e', '544e7b37-34ac-42c6-a973-4e3de7762947', '8f60147d-b931-488d-876e-01830746f0e5', '43a4df49-7816-4678-be36-250c471235e3', '13736951-03c6-4d53-ad2b-da3bf377face', '4589a5a7-4543-448d-9e0a-cd5d1c274131', '71e93a62-f682-47ff-92e4-1f8bd5455449', 'db3579e6-ea77-4102-ba19-0829034e0bac', '52365fff-e017-4d11-ba53-f5893d863536'} {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1305.187948] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1305.207964] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.207964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.207964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.207964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.207964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.207964] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1305.208385] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1305.208385] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1305.297228] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.297394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.297468] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.297849] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.299087] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.299466] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1305.299588] env[65359]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65359) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1305.299718] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1305.299812] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1305.299931] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 1305.300029] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eabb3370-dfe1-4663-be08-bc9370ee3284 with Priority: HIGH for action security_group_rules [ 1305.300125] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGH for action security_group_rules [ 1305.300214] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGH for action security_group_rules [ 1305.300284] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 588bed60-cf0f-4c53-9608-288d006dd2be with Priority: HIGH for action security_group_rules [ 1305.300350] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc with Priority: HIGH for action security_group_rules [ 1305.300415] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGH for action security_group_rules [ 1305.300476] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGH for action security_group_rules [ 1305.300545] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGH for action security_group_rules [ 1305.300735] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGH for action security_group_rules [ 1305.300735] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGH for action security_group_rules [ 1305.300972] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e with Priority: HIGH for action security_group_rules [ 1305.300972] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c with Priority: HIGH for action security_group_rules [ 1305.301076] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGH for action security_group_rules [ 1305.301158] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGH for action security_group_rules [ 1305.301271] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGH for action security_group_rules [ 1305.301347] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 505f1bca-748c-4f56-9f01-2a595d335a84 with Priority: HIGH for action security_group_rules [ 1305.301451] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGH for action security_group_rules [ 1305.301523] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 with Priority: HIGH for action security_group_rules [ 1305.301624] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGH for action security_group_rules [ 1305.301725] env[65359]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGH for action security_group_rules [ 1305.301897] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.866996] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1305.867408] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1305.867408] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eabb3370-dfe1-4663-be08-bc9370ee3284 with Priority: HIGH for action security_group_rules [ 1305.867408] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGH for action security_group_rules [ 1305.867538] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 with Priority: HIGH for action security_group_rules [ 1305.867538] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a73e88-8afb-4866-a66b-2583f493db5e with Priority: HIGH for action security_group_rules [ 1305.867618] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 with Priority: HIGH for action security_group_rules [ 1305.867696] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cd6ed2-10e9-4291-bb94-80714475749a with Priority: HIGH for action security_group_rules [ 1305.867787] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 with Priority: HIGH for action security_group_rules [ 1305.867918] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28737c44-388f-4cb8-9cac-0181cbb28981 with Priority: HIGH for action security_group_rules [ 1305.868023] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGH for action security_group_rules [ 1305.868110] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505f1bca-748c-4f56-9f01-2a595d335a84 with Priority: HIGH for action security_group_rules [ 1305.868196] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07f94052-66b8-4ea9-9b43-7b740cc698df with Priority: HIGH for action security_group_rules [ 1305.868281] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c with Priority: HIGH for action security_group_rules [ 1305.868365] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e with Priority: HIGH for action security_group_rules [ 1305.868448] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb with Priority: HIGH for action security_group_rules [ 1305.868532] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGH for action security_group_rules [ 1305.868616] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dca704-f8c2-494f-bbf6-802020c49b4b with Priority: HIGH for action security_group_rules [ 1305.868703] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 with Priority: HIGH for action security_group_rules [ 1305.868788] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc with Priority: HIGH for action security_group_rules [ 1305.868872] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 with Priority: HIGH for action security_group_rules [ 1305.868959] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588bed60-cf0f-4c53-9608-288d006dd2be with Priority: HIGH for action security_group_rules [ 1305.869310] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eabb3370-dfe1-4663-be08-bc9370ee3284 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.869442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.869519] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.869729] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.869813] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eabb3370-dfe1-4663-be08-bc9370ee3284',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.870912] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.871114] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.871114] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.871319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.871378] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.872161] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0a461a8-ce41-468d-b9bb-19fef2690b98 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.872267] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.872335] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.872906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.872906] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0a461a8-ce41-468d-b9bb-19fef2690b98',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.873844] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4a73e88-8afb-4866-a66b-2583f493db5e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.873844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.874018] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.874073] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.874114] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4a73e88-8afb-4866-a66b-2583f493db5e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.874911] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.875037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.875037] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.875156] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.875224] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9eb6909a-01a5-44eb-b7ac-9d4770a02fb6',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.875980] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83cd6ed2-10e9-4291-bb94-80714475749a taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.876070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.876111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.876403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.876403] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83cd6ed2-10e9-4291-bb94-80714475749a',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.876966] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bf93232-d104-4fc5-a8d6-ea22dbf41b58 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.877083] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.877145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.877293] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.877361] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bf93232-d104-4fc5-a8d6-ea22dbf41b58',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.878304] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28737c44-388f-4cb8-9cac-0181cbb28981 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.878304] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.878459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.878501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.878545] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28737c44-388f-4cb8-9cac-0181cbb28981',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.879216] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.879321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.879386] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.880027] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.880027] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.880283] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-505f1bca-748c-4f56-9f01-2a595d335a84 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.880389] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.880453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.880597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.880705] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('505f1bca-748c-4f56-9f01-2a595d335a84',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.881457] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07f94052-66b8-4ea9-9b43-7b740cc698df taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.881619] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.881619] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.882354] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.882354] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07f94052-66b8-4ea9-9b43-7b740cc698df',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.882489] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.882594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.882660] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.882835] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.882887] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.883579] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.883717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.883717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.884174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.884174] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c69a6fc7-9355-4fca-ac8f-5d59227f6c2e',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.884700] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.884700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.884832] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.884889] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.884955] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6b655ed-9de5-4842-96d3-3652c9e45ddb',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.885771] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.885870] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.886412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.886412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.886412] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.886860] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4dca704-f8c2-494f-bbf6-802020c49b4b taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.886949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.886949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.887117] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.887189] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4dca704-f8c2-494f-bbf6-802020c49b4b',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.887984] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.887984] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.888134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.888175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.888236] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.888937] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.889149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.889211] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.889352] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.889420] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19016fc0-c721-4fe7-a048-5f4ea75fecfc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.890118] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.890275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.890275] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.890412] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.890481] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6599e228-9d5e-4d59-9a87-ffa7ce620eb9',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.891271] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-588bed60-cf0f-4c53-9608-288d006dd2be taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.891271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.891417] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.891536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.891894] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('588bed60-cf0f-4c53-9608-288d006dd2be',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.915824] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.916070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.916070] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.916289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.920510] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.920636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.944508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.944665] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0a461a8-ce41-468d-b9bb-19fef2690b98 is going to be deleted. [ 1305.945565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.945813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.964507] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.964672] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4a73e88-8afb-4866-a66b-2583f493db5e is going to be deleted. [ 1306.002883] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.003123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.003123] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.003349] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.003439] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.003613] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0a461a8-ce41-468d-b9bb-19fef2690b98" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.008388] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.008549] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.008611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.008734] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.008824] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.008937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4a73e88-8afb-4866-a66b-2583f493db5e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.401290] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb52c5b-5242-481b-b676-5b24fc2c97d8 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.401642] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.401751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.402043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.402325] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.402511] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.402648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.402932] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.403115] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.403312] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.403483] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.405813] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-19016fc0-c721-4fe7-a048-5f4ea75fecfc taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.405950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.406097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.406355] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.406606] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.406786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.406869] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.407112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.407264] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.407417] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.407569] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19016fc0-c721-4fe7-a048-5f4ea75fecfc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.421434] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.423368] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19016fc0-c721-4fe7-a048-5f4ea75fecfc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.426067] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-eabb3370-dfe1-4663-be08-bc9370ee3284 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.426067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.426067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.426379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.426582] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.426775] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.426867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.427145] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.427292] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.427444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.427597] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eabb3370-dfe1-4663-be08-bc9370ee3284',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.430679] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.430960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.430960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.431265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.431520] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.431701] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.431825] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.432086] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.432233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.432373] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.432526] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.439846] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19016fc0-c721-4fe7-a048-5f4ea75fecfc: rpc.has_security_group_logging(os_id): False [ 1306.442313] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eabb3370-dfe1-4663-be08-bc9370ee3284',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.443562] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cfb52c5b-5242-481b-b676-5b24fc2c97d8: rpc.has_security_group_logging(os_id): False [ 1306.459561] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eabb3370-dfe1-4663-be08-bc9370ee3284: rpc.has_security_group_logging(os_id): False [ 1306.479459] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.479618] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.479686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.479906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.481551] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.481657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.531638] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.531844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.532733] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.532883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.533678] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.533771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.535830] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.535975] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.553766] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.553928] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.554718] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.554833] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.565440] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.565615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.567105] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.567255] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.567998] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.568126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.568721] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.569140] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.569232] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.569825] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.570258] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.570405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.570937] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.571305] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.571408] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.571988] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.572372] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.572453] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.573082] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.573481] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.573599] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.574178] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.574535] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.574641] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.583257] env[65359]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.583902] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.584320] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 is going to be deleted. [ 1306.584937] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.585154] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.613803] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.614148] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3 is going to be deleted. [ 1306.615326] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.615573] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.641753] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.641989] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c is going to be deleted. [ 1306.643091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.643282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.666561] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.666732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.694441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.694441] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28737c44-388f-4cb8-9cac-0181cbb28981 is going to be deleted. [ 1306.695564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.695859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.720879] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.721047] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.735699] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.735915] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4dca704-f8c2-494f-bbf6-802020c49b4b is going to be deleted. [ 1306.737508] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.737774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.752723] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.752874] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.757980] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.758311] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.758429] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.758514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.758751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.758843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.758944] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 is going to be updated. [ 1306.760105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.760279] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.802276] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.802468] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9eb6909a-01a5-44eb-b7ac-9d4770a02fb6 is going to be deleted. [ 1306.803540] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.803808] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.861983] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.862321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.866000] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.866289] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.876046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.876485] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83cd6ed2-10e9-4291-bb94-80714475749a is going to be deleted. [ 1306.877459] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.877722] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.927992] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.928299] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.932924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.933160] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 505f1bca-748c-4f56-9f01-2a595d335a84 is going to be deleted. [ 1306.934030] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.934258] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.946348] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.985894] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.986278] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.986411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.986485] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.986720] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.986808] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.986911] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc is going to be updated. [ 1306.988031] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.988205] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.007731] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.007953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.008813] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.008967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.029811] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.030064] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bf93232-d104-4fc5-a8d6-ea22dbf41b58 is going to be deleted. [ 1307.030939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.031284] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.104946] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.105155] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6b655ed-9de5-4842-96d3-3652c9e45ddb is going to be deleted. [ 1307.106051] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.106285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.154439] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.154694] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.155779] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.155876] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.156844] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.156942] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c69a6fc7-9355-4fca-ac8f-5d59227f6c2e is going to be deleted. [ 1307.157885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.158111] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.202855] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.203097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.210863] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.211030] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07f94052-66b8-4ea9-9b43-7b740cc698df is going to be deleted. [ 1307.211931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.212152] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.303119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.303514] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.303627] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.303719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.303988] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.304098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.304214] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eabb3370-dfe1-4663-be08-bc9370ee3284 is going to be updated. [ 1307.305431] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.305715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.305800] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.305950] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.306105] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.306277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.306353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.306467] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce1a44a-055e-4a01-bd7c-9f1a4a59bbf3" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.306657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.306829] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.306912] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.307080] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc0ee5f2-2ed4-4c88-baa2-aedb9d6bea6c" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.307212] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.307380] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.346685] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.346893] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.439616] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.439616] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6599e228-9d5e-4d59-9a87-ffa7ce620eb9 is going to be deleted. [ 1307.440462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.440462] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.440690] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.440761] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28737c44-388f-4cb8-9cac-0181cbb28981" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.441822] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.441929] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.441997] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.442202] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.442280] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.442431] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c69a6fc7-9355-4fca-ac8f-5d59227f6c2e" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.442609] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.442781] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.442913] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.444424] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.444606] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.448441] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3577cfc-adec-4c56-bc24-6acdb8887663: rpc.has_security_group_logging(os_id): False [ 1307.453928] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.454094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.481693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.481910] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 588bed60-cf0f-4c53-9608-288d006dd2be is going to be deleted. [ 1307.483132] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.483408] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.483551] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.483708] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83cd6ed2-10e9-4291-bb94-80714475749a" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.483931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.484147] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.484265] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.484411] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-505f1bca-748c-4f56-9f01-2a595d335a84" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.485046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.485260] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.485425] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.486611] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.486771] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.486873] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.487063] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bf93232-d104-4fc5-a8d6-ea22dbf41b58" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.487239] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.487419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.487500] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.487663] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4dca704-f8c2-494f-bbf6-802020c49b4b" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.488227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.488419] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.488520] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.488660] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6b655ed-9de5-4842-96d3-3652c9e45ddb" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.488838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.489023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.489119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.489236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9eb6909a-01a5-44eb-b7ac-9d4770a02fb6" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.489415] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.489568] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.489672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.489808] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07f94052-66b8-4ea9-9b43-7b740cc698df" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.503310] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: IN_PROGRESS for 2s [ 1307.544356] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.544550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.544610] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.544843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.554602] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.554823] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.642770] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc in Status: IN_PROGRESS for 2s [ 1307.653272] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.653711] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.653908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.653908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.654134] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.654221] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.654299] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 is going to be updated. [ 1307.655454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.655719] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.655906] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.666160] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.666378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.666378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.666583] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.666736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.666838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6599e228-9d5e-4d59-9a87-ffa7ce620eb9" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.680593] env[65359]: INFO networking_nsxv3.common.synchronization [req-dc589f88-9b89-4e0b-9cc7-66941a994376 req-32f84372-dde7-4dc4-b9bf-d348fc78c611 tempest-ServerActionsTestJSON-975876043 tempest-ServerActionsTestJSON-975876043-project-member] Enqueued Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 1307.681334] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3577cfc-adec-4c56-bc24-6acdb8887663 with Priority: HIGHEST for action security_group_members [ 1307.681688] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3577cfc-adec-4c56-bc24-6acdb8887663 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.681827] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.681898] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.682126] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.682287] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.682399] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.682451] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.682982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.682982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.682982] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3577cfc-adec-4c56-bc24-6acdb8887663',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.733146] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eabb3370-dfe1-4663-be08-bc9370ee3284 in Status: IN_PROGRESS for 2s [ 1307.768745] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.768969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.768969] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.769196] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.769295] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.769420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-588bed60-cf0f-4c53-9608-288d006dd2be" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.894348] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.894751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.894751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.894845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.895041] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.967285] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: IN_PROGRESS for 2s [ 1308.185347] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.185673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.185774] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.185983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.186136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.186430] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.186570] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.186666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.186912] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.187023] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.187194] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 is going to be updated. [ 1308.225241] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.225442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.225492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.225751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.225892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.237317] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: IN_PROGRESS for 2s [ 1309.520657] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: SUCCESS [ 1309.520995] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.658448] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc in Status: SUCCESS [ 1309.658697] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.748659] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eabb3370-dfe1-4663-be08-bc9370ee3284 in Status: SUCCESS [ 1309.748882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.984144] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: SUCCESS [ 1309.984401] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.251183] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3577cfc-adec-4c56-bc24-6acdb8887663 in Status: SUCCESS [ 1310.251378] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3577cfc-adec-4c56-bc24-6acdb8887663 deletion is rescheduled due to dependency. [ 1310.251498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3577cfc-adec-4c56-bc24-6acdb8887663" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.682712] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1312.683095] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1316.218120] env[65359]: INFO networking_nsxv3.common.synchronization [None req-8b4d199d-d652-4519-85fe-004b30cde4cf None None] Enqueued Resource ID: d79c2cf6-20b3-4b9a-bcf2-0fc0181cb5f8 with Priority: HIGHEST for action port [ 1316.219883] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79c2cf6-20b3-4b9a-bcf2-0fc0181cb5f8 with Priority: HIGHEST for action port [ 1316.219883] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-d79c2cf6-20b3-4b9a-bcf2-0fc0181cb5f8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.219883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d79c2cf6-20b3-4b9a-bcf2-0fc0181cb5f8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.219883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d79c2cf6-20b3-4b9a-bcf2-0fc0181cb5f8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.219883] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d79c2cf6-20b3-4b9a-bcf2-0fc0181cb5f8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.219883] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d79c2cf6-20b3-4b9a-bcf2-0fc0181cb5f8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.568398] env[65359]: INFO networking_nsxv3.common.synchronization [req-f42293a0-3e00-40b5-b095-77e14ec93d9b req-834b553b-7b30-4972-89a8-73297992836c tempest-AttachVolumeNegativeTest-817130833 tempest-AttachVolumeNegativeTest-817130833-project-member] Enqueued Resource ID: eabb3370-dfe1-4663-be08-bc9370ee3284 with Priority: HIGHEST for action security_group_members [ 1316.568960] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eabb3370-dfe1-4663-be08-bc9370ee3284 with Priority: HIGHEST for action security_group_members [ 1316.569576] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-eabb3370-dfe1-4663-be08-bc9370ee3284 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.569576] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.569576] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.569770] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.569998] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.570136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.570332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.570393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.570441] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.570533] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eabb3370-dfe1-4663-be08-bc9370ee3284',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.721558] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d79c2cf6-20b3-4b9a-bcf2-0fc0181cb5f8 [ 1316.721813] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.721953] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.722043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.722282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.722378] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.722473] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d79c2cf6-20b3-4b9a-bcf2-0fc0181cb5f8 already deleted. [ 1316.722560] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d79c2cf6-20b3-4b9a-bcf2-0fc0181cb5f8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.073091] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.073261] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.073334] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.073550] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.073664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.074405] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.074405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.074405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.074405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.074405] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.074405] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eabb3370-dfe1-4663-be08-bc9370ee3284 is going to be updated. [ 1317.109720] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.109917] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.110074] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.110368] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.110614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.120868] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eabb3370-dfe1-4663-be08-bc9370ee3284 in Status: IN_PROGRESS for 2s [ 1318.594490] env[65359]: INFO networking_nsxv3.common.synchronization [None req-42a32fc9-34b8-4774-a942-fc4b91be7f79 None None] Enqueued Resource ID: fe7deda0-9e10-41f3-a018-b1c840e21a11 with Priority: HIGHEST for action port [ 1318.595045] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7deda0-9e10-41f3-a018-b1c840e21a11 with Priority: HIGHEST for action port [ 1318.595370] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe7deda0-9e10-41f3-a018-b1c840e21a11 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.595650] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe7deda0-9e10-41f3-a018-b1c840e21a11" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.595763] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe7deda0-9e10-41f3-a018-b1c840e21a11" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.596067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe7deda0-9e10-41f3-a018-b1c840e21a11" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.596174] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe7deda0-9e10-41f3-a018-b1c840e21a11',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.098560] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe7deda0-9e10-41f3-a018-b1c840e21a11 [ 1319.098843] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.099049] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.099173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.099394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.099514] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.099624] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe7deda0-9e10-41f3-a018-b1c840e21a11 already deleted. [ 1319.099715] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe7deda0-9e10-41f3-a018-b1c840e21a11" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.132411] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eabb3370-dfe1-4663-be08-bc9370ee3284 in Status: SUCCESS [ 1319.132589] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eabb3370-dfe1-4663-be08-bc9370ee3284 deletion is rescheduled due to dependency. [ 1319.132672] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eabb3370-dfe1-4663-be08-bc9370ee3284" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.854911] env[65359]: INFO networking_nsxv3.common.synchronization [req-287a86c2-7e13-49ec-b59a-fc4153502399 req-2b7380b9-6f72-4cb7-8bee-28afb3f4c0fd tempest-ServerPasswordTestJSON-518212430 tempest-ServerPasswordTestJSON-518212430-project-member] Enqueued Resource ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 with Priority: HIGHEST for action security_group_members [ 1322.855455] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 with Priority: HIGHEST for action security_group_members [ 1322.855966] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0a6993e-ab71-4fa3-b450-58dd708157a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.856374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.856374] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.856452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.856664] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.856845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.856845] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.856964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.856964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.857147] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0a6993e-ab71-4fa3-b450-58dd708157a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.231596] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.231596] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "network-119" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.231873] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "network-119" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.232256] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "network-119" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.232666] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.232866] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.233051] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.233350] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.233588] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.233836] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1323.233998] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1323.234181] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1323.234587] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1323.234587] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1323.234712] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1323.234784] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1323.271607] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1323.271810] env[65359]: DEBUG dogpile.cache.region [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1323.272035] env[65359]: DEBUG dogpile.lock [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1323.272273] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "network-119" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.272628] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock port-c1cb733c-36ae-49ef-8cd6-a61799455dd1 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.272860] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "port-c1cb733c-36ae-49ef-8cd6-a61799455dd1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.273026] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "port-c1cb733c-36ae-49ef-8cd6-a61799455dd1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.273375] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "port-c1cb733c-36ae-49ef-8cd6-a61799455dd1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.273601] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1cb733c-36ae-49ef-8cd6-a61799455dd1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.359584] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.359788] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.359843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.360062] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.360176] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.360368] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.360469] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.360532] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.360686] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.360760] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.360844] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 already deleted. [ 1323.360923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.777265] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.777265] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.777265] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.777265] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.777629] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.777629] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Segment Port c1cb733c-36ae-49ef-8cd6-a61799455dd1 not found, creating... [ 1323.778763] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.778763] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.778763] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.778763] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.778763] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.778763] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.779160] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.779195] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.779401] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.779532] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.781152] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Resource: SegmentPort with ID: c1cb733c-36ae-49ef-8cd6-a61799455dd1 is going to be created. [ 1323.803058] env[65359]: DEBUG networking_nsxv3.common.locking [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.803058] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.803058] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.803058] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.803471] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.803471] env[65359]: DEBUG oslo_concurrency.lockutils [None req-5a0bdcb3-a8e7-45dd-aacb-5562b6e6ae3b None None] Releasing lock "port-c1cb733c-36ae-49ef-8cd6-a61799455dd1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.917433] env[65359]: INFO networking_nsxv3.common.synchronization [req-287a86c2-7e13-49ec-b59a-fc4153502399 req-866467e0-bf2a-4a9a-a3af-b5f0951bb84a service nova] Enqueued Resource ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 with Priority: HIGHEST for action security_group_rules [ 1324.917433] env[65359]: INFO networking_nsxv3.common.synchronization [req-287a86c2-7e13-49ec-b59a-fc4153502399 req-866467e0-bf2a-4a9a-a3af-b5f0951bb84a service nova] Enqueued Resource ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 with Priority: HIGHEST for action security_group_members [ 1324.917867] env[65359]: INFO networking_nsxv3.common.synchronization [req-287a86c2-7e13-49ec-b59a-fc4153502399 req-866467e0-bf2a-4a9a-a3af-b5f0951bb84a service nova] Enqueued Resource ID: c1cb733c-36ae-49ef-8cd6-a61799455dd1 with Priority: HIGHEST for action port [ 1324.919026] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 with Priority: HIGHEST for action security_group_rules [ 1324.919989] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 with Priority: HIGHEST for action security_group_members [ 1324.919989] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1cb733c-36ae-49ef-8cd6-a61799455dd1 with Priority: HIGHEST for action port [ 1324.919989] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0a6993e-ab71-4fa3-b450-58dd708157a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.919989] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.920296] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.920427] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.920505] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0a6993e-ab71-4fa3-b450-58dd708157a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.921383] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0a6993e-ab71-4fa3-b450-58dd708157a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.921536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.921634] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.921843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.922030] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.922158] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.922271] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.922414] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.922522] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.923666] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0a6993e-ab71-4fa3-b450-58dd708157a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.923666] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1cb733c-36ae-49ef-8cd6-a61799455dd1 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.923666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1cb733c-36ae-49ef-8cd6-a61799455dd1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.923666] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1cb733c-36ae-49ef-8cd6-a61799455dd1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.924142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1cb733c-36ae-49ef-8cd6-a61799455dd1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.924142] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1cb733c-36ae-49ef-8cd6-a61799455dd1',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.426376] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0a6993e-ab71-4fa3-b450-58dd708157a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.427565] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0a6993e-ab71-4fa3-b450-58dd708157a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.427711] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.428291] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1cb733c-36ae-49ef-8cd6-a61799455dd1 with status ACTIVE [ 1325.428291] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.428291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.428291] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.428741] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.428741] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.428741] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.428741] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.428908] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.429353] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.429493] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.429707] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.429817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.429882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.430052] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.430173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.430233] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1cb733c-36ae-49ef-8cd6-a61799455dd1 is going to be updated. [ 1325.456389] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.456554] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.456628] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.456861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.457013] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.457182] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1cb733c-36ae-49ef-8cd6-a61799455dd1" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.932408] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0a6993e-ab71-4fa3-b450-58dd708157a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.435572] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.435813] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.435885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.436118] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.436211] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.436312] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 is going to be created. [ 1326.464602] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.464840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.464840] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.465009] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.465173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.474477] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 in Status: UNINITIALIZED for 2s [ 1328.488530] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 in Status: SUCCESS [ 1328.489112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.489112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.489112] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.489320] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.489452] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.489501] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.489648] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.489732] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.489820] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.489912] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0a6993e-ab71-4fa3-b450-58dd708157a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.992886] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0a6993e-ab71-4fa3-b450-58dd708157a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.993136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.993189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.993403] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.993629] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.993750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.993819] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.993982] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.994087] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.994186] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.994353] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0a6993e-ab71-4fa3-b450-58dd708157a5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.994442] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.994503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.994647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.994784] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.994876] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.994939] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.995092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.995192] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.995285] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.995392] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0a6993e-ab71-4fa3-b450-58dd708157a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.432178] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-400 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.432386] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.432511] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.432781] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.433108] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.433263] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.433325] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.433542] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.433718] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.433942] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1329.434065] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1329.434176] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1329.434280] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1329.434386] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1329.434488] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1329.434614] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1329.455408] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1329.455603] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1329.455751] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1329.455961] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-400" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.456300] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.456480] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.456595] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.456901] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.457058] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.498066] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0a6993e-ab71-4fa3-b450-58dd708157a5: rpc.has_security_group_logging(os_id): False [ 1329.518761] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.518933] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.518983] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.519208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.519294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.519516] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.519594] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.519636] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.519787] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.519867] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.520064] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.520170] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.520228] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.520372] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.520445] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.520629] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.520750] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.520804] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.520919] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.521007] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.521089] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 is going to be created. [ 1329.594801] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.594960] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.595043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.595329] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.595537] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.610142] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 in Status: IN_PROGRESS for 2s [ 1329.920974] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1329.921172] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1329.960524] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.960780] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.960927] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.961232] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.961388] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.961903] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.961903] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.962085] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.962185] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.962317] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.962595] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.962751] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.962867] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.963086] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.963220] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.963360] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f is going to be updated. [ 1329.985314] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.985571] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.985754] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.986061] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.986260] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.986483] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.725130] env[65359]: INFO networking_nsxv3.common.synchronization [req-74a27aef-c4e8-4ade-abcb-c32987f71960 req-49402bb1-b803-45f8-8ab3-9269cb6e1d36 service nova] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_rules [ 1330.725130] env[65359]: INFO networking_nsxv3.common.synchronization [req-74a27aef-c4e8-4ade-abcb-c32987f71960 req-49402bb1-b803-45f8-8ab3-9269cb6e1d36 service nova] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1330.725561] env[65359]: INFO networking_nsxv3.common.synchronization [req-74a27aef-c4e8-4ade-abcb-c32987f71960 req-49402bb1-b803-45f8-8ab3-9269cb6e1d36 service nova] Enqueued Resource ID: 2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f with Priority: HIGHEST for action port [ 1330.725775] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_rules [ 1330.725915] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1330.726026] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f with Priority: HIGHEST for action port [ 1330.726311] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.726433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.726526] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.726757] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.726827] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.727653] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.727768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.727838] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.728019] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.728220] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.728347] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.728426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.728541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.728664] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.728717] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.729764] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.729882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.729940] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.730104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.730185] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.232278] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.232278] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.233781] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.233781] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f with status ACTIVE [ 1331.234084] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.234227] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.234336] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.234638] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.234793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.236224] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.236224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.236224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.236224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.236224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.236467] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.236535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.236535] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.236700] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.236822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.236922] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f is going to be updated. [ 1331.262905] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.262905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.262905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.262905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.262905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.263321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f5d6b62-64c3-445a-ba1e-6d1dbe34e92f" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.625552] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 in Status: SUCCESS [ 1331.625843] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.738992] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.241631] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.241816] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.241931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.242244] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.242308] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.242524] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 is going to be updated. [ 1332.277640] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.278068] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.278173] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.278444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.278716] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.289932] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: IN_PROGRESS for 2s [ 1334.303115] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: SUCCESS [ 1334.303523] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.303590] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.303859] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.304072] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.304208] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.304274] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.304448] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.304531] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.304617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.304709] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.807060] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.309797] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93f7f41b-56ed-4593-aafe-31057cf7c6f5: rpc.has_security_group_logging(os_id): False [ 1335.332778] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.333054] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.333054] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.333306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.358655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.359088] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.359228] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.359300] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.359505] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.359588] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.359680] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 is going to be updated. [ 1335.444155] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.444426] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.444597] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.444861] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.445038] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.462373] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: IN_PROGRESS for 2s [ 1335.727481] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.727679] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1335.945230] env[65359]: INFO networking_nsxv3.common.synchronization [req-6e53fee0-1ee8-41b6-982e-de7759e7cac7 req-271cc9ae-ff28-42de-b3a7-cf125f43f071 tempest-ServerPasswordTestJSON-518212430 tempest-ServerPasswordTestJSON-518212430-project-member] Enqueued Resource ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 with Priority: HIGHEST for action security_group_members [ 1335.946010] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 with Priority: HIGHEST for action security_group_members [ 1335.946461] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0a6993e-ab71-4fa3-b450-58dd708157a5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.947174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.947454] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.947607] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.947991] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.947991] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.948142] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.948339] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.948476] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.948635] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0a6993e-ab71-4fa3-b450-58dd708157a5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.451258] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.451659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.451659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.451735] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.451839] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.452175] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.452175] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.452393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.452393] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.452506] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.452506] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 is going to be updated. [ 1336.483609] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.483790] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.483884] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.484137] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.484288] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.494636] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 in Status: IN_PROGRESS for 2s [ 1337.499232] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: SUCCESS [ 1337.499615] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.505655] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 in Status: SUCCESS [ 1338.505655] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0a6993e-ab71-4fa3-b450-58dd708157a5 deletion is rescheduled due to dependency. [ 1338.505655] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0a6993e-ab71-4fa3-b450-58dd708157a5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.947078] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.947466] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.948152] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.948444] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1347.146061] env[65359]: INFO networking_nsxv3.common.synchronization [req-56763d0b-444c-4ed0-b5ea-97c051d0f0bb req-dc903812-a0bc-4da0-aef4-ca9f8cce2d50 tempest-ServerActionsTestOtherB-968321773 tempest-ServerActionsTestOtherB-968321773-project-member] Enqueued Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1347.146628] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 with Priority: HIGHEST for action security_group_members [ 1347.146954] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-93f7f41b-56ed-4593-aafe-31057cf7c6f5 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.147782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.147782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.147782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.147782] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.147782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.147782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.148277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.148277] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.148277] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93f7f41b-56ed-4593-aafe-31057cf7c6f5',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.650866] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.651092] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.651144] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.651333] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.651427] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.651626] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.651726] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.651789] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.652015] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.652156] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.652264] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 is going to be updated. [ 1347.689871] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.690119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.690119] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.690306] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.690446] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.700874] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: IN_PROGRESS for 2s [ 1349.712455] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: IN_PROGRESS for 4s [ 1351.728449] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 in Status: SUCCESS [ 1351.728919] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93f7f41b-56ed-4593-aafe-31057cf7c6f5 deletion is rescheduled due to dependency. [ 1351.728919] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93f7f41b-56ed-4593-aafe-31057cf7c6f5" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.147890] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1352.148126] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1354.556444] env[65359]: INFO networking_nsxv3.common.synchronization [req-f5d76e34-327e-4ef0-9ce2-4ad9ac5d0bb1 req-e4f5af2a-7dae-46c1-906c-56cf47ba386c tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc with Priority: HIGHEST for action security_group_members [ 1354.556721] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc with Priority: HIGHEST for action security_group_members [ 1354.556992] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-19016fc0-c721-4fe7-a048-5f4ea75fecfc taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.558324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.558324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.558324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.558324] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.558324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.558324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.558324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.558324] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.558324] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19016fc0-c721-4fe7-a048-5f4ea75fecfc',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.061030] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.061236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.061315] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.061536] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.061629] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.061831] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.061955] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.062033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.062189] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.062268] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.062351] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc is going to be updated. [ 1355.091715] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.091879] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.091925] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.093258] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.093258] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.102862] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc in Status: IN_PROGRESS for 2s [ 1357.114613] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc in Status: SUCCESS [ 1357.114901] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19016fc0-c721-4fe7-a048-5f4ea75fecfc deletion is rescheduled due to dependency. [ 1357.114901] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19016fc0-c721-4fe7-a048-5f4ea75fecfc" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.558537] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.558900] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1363.730613] env[65359]: INFO networking_nsxv3.common.synchronization [req-17b1f8a4-2a7e-47d2-ba64-0eb17c0c9b8b req-70930fba-5bf8-432d-a876-3da4d42ffe2a tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_members [ 1363.731168] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_members [ 1363.731476] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.731592] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.731659] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.731851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.732012] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.732113] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.732174] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.732322] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.732430] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.732527] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.033096] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-854 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.033302] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.033426] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.033687] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.033956] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.034129] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.034245] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.034462] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.034606] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.034827] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1364.034936] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1364.035052] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1364.035160] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1364.035269] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1364.035377] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1364.035504] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1364.058521] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1364.058706] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1364.058828] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1364.058962] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.059401] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-f657a2b5-8cc3-4973-9182-d510d5789aa8 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.059537] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-f657a2b5-8cc3-4973-9182-d510d5789aa8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.059641] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-f657a2b5-8cc3-4973-9182-d510d5789aa8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.059957] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-f657a2b5-8cc3-4973-9182-d510d5789aa8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.060112] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f657a2b5-8cc3-4973-9182-d510d5789aa8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.234622] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.234814] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.234865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.235080] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.235247] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.235443] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.235541] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.235602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.235754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.235830] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.236122] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 is going to be deleted. [ 1364.272984] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.273222] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.273282] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.273460] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.273551] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.273647] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.562775] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.563073] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.563208] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.563490] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.563640] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.563796] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port f657a2b5-8cc3-4973-9182-d510d5789aa8 not found, creating... [ 1364.564088] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.564244] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.564360] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.564593] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.564748] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.565048] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.565206] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.565322] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.565526] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.565659] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.565797] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: f657a2b5-8cc3-4973-9182-d510d5789aa8 is going to be created. [ 1364.589416] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.589645] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.589769] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.590036] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.590258] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.590478] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-f657a2b5-8cc3-4973-9182-d510d5789aa8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.284333] env[65359]: INFO networking_nsxv3.common.synchronization [req-17b1f8a4-2a7e-47d2-ba64-0eb17c0c9b8b req-9c5aaba5-da83-40aa-95b1-bf1d9f2c47b3 service nova] Enqueued Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_rules [ 1365.284636] env[65359]: INFO networking_nsxv3.common.synchronization [req-17b1f8a4-2a7e-47d2-ba64-0eb17c0c9b8b req-9c5aaba5-da83-40aa-95b1-bf1d9f2c47b3 service nova] Enqueued Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_members [ 1365.284636] env[65359]: INFO networking_nsxv3.common.synchronization [req-17b1f8a4-2a7e-47d2-ba64-0eb17c0c9b8b req-9c5aaba5-da83-40aa-95b1-bf1d9f2c47b3 service nova] Enqueued Resource ID: f657a2b5-8cc3-4973-9182-d510d5789aa8 with Priority: HIGHEST for action port [ 1365.285149] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_rules [ 1365.285293] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_members [ 1365.285394] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f657a2b5-8cc3-4973-9182-d510d5789aa8 with Priority: HIGHEST for action port [ 1365.285635] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.285751] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.285818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.286224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.286291] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.287539] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.287652] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.287785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.287885] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.288071] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.288167] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.288230] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.288404] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.289394] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.289394] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.290011] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-f657a2b5-8cc3-4973-9182-d510d5789aa8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.290135] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f657a2b5-8cc3-4973-9182-d510d5789aa8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.290274] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f657a2b5-8cc3-4973-9182-d510d5789aa8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.290437] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f657a2b5-8cc3-4973-9182-d510d5789aa8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.290514] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f657a2b5-8cc3-4973-9182-d510d5789aa8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.792669] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.792822] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.793088] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.794074] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f657a2b5-8cc3-4973-9182-d510d5789aa8 with status ACTIVE [ 1365.794274] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.794430] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.794504] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.794759] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.794850] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.795089] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.795200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.795262] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.795475] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.795559] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.795786] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.795891] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.795962] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.796443] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.796443] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.796443] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f657a2b5-8cc3-4973-9182-d510d5789aa8 is going to be updated. [ 1365.821074] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.821319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.821391] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.821660] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.821904] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.822097] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f657a2b5-8cc3-4973-9182-d510d5789aa8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.298349] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.800480] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.800785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.800785] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.800934] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.801039] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.801141] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 is going to be created. [ 1366.823387] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.823614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.823614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.823791] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.823963] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.835890] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 in Status: UNINITIALIZED for 2s [ 1368.847801] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 in Status: SUCCESS [ 1368.848213] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.848213] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.848432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.848616] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.848731] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.848795] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.848942] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.849035] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.849127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.849217] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.351579] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.351817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.351817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.352127] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.352323] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.352433] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.352520] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.352721] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.352810] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.352905] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.353077] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.353224] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.353317] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.353534] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.353686] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.353819] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.353931] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.354124] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.354242] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.354344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.354473] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.856934] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28a192d2-893c-4c78-805e-fa2fb948ce50: rpc.has_security_group_logging(os_id): False [ 1369.874862] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.875082] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.875082] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.875252] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.875341] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.875564] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.875665] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.875727] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.875872] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.875949] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.876179] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.876281] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.876344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.876487] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.876561] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.876738] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.876831] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.876892] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.877093] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.877204] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.877297] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 is going to be created. [ 1369.935033] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.935295] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.935295] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.935857] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.936104] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.948387] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 in Status: IN_PROGRESS for 2s [ 1370.286456] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1370.286667] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1371.965028] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 in Status: SUCCESS [ 1371.965286] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.692866] env[65359]: INFO networking_nsxv3.common.synchronization [req-939df45b-b308-4bb3-8820-7d8db47d663f req-bcf7c4a0-29a1-40e5-9035-de26b8c2f03c tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_members [ 1372.693442] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 with Priority: HIGHEST for action security_group_members [ 1372.693755] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a192d2-893c-4c78-805e-fa2fb948ce50 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.693882] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.693971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.694193] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.694348] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.694473] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.694542] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.694691] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.694782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.694874] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a192d2-893c-4c78-805e-fa2fb948ce50',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.736544] env[65359]: INFO networking_nsxv3.common.synchronization [req-939df45b-b308-4bb3-8820-7d8db47d663f req-bcf7c4a0-29a1-40e5-9035-de26b8c2f03c tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: f657a2b5-8cc3-4973-9182-d510d5789aa8 with Priority: HIGHEST for action port [ 1372.737126] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f657a2b5-8cc3-4973-9182-d510d5789aa8 with Priority: HIGHEST for action port [ 1372.737658] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-f657a2b5-8cc3-4973-9182-d510d5789aa8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.737782] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f657a2b5-8cc3-4973-9182-d510d5789aa8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.737851] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f657a2b5-8cc3-4973-9182-d510d5789aa8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.738056] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f657a2b5-8cc3-4973-9182-d510d5789aa8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.738140] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f657a2b5-8cc3-4973-9182-d510d5789aa8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.197699] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.198067] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.198121] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.198332] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.198432] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.198632] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.198736] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.198801] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.198945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.199046] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.199141] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 is going to be updated. [ 1373.230501] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.230717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.230717] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.230923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.231076] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.240613] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 in Status: IN_PROGRESS for 2s [ 1373.240613] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f657a2b5-8cc3-4973-9182-d510d5789aa8 with status ACTIVE [ 1373.240923] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.240923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.240923] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.241236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.241236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.241379] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.241379] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.241591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.241591] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.241754] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.241839] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.241924] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.241994] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.242136] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.242236] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.242236] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f657a2b5-8cc3-4973-9182-d510d5789aa8 is going to be updated. [ 1373.264401] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.264707] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.264815] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.265139] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.265344] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.265579] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f657a2b5-8cc3-4973-9182-d510d5789aa8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.252193] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 in Status: SUCCESS [ 1375.252614] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a192d2-893c-4c78-805e-fa2fb948ce50 deletion is rescheduled due to dependency. [ 1375.252614] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a192d2-893c-4c78-805e-fa2fb948ce50" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.738408] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.738962] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1382.739447] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1382.739779] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1387.740484] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1387.740857] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1392.742113] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.742113] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.037649] env[65359]: INFO networking_nsxv3.common.synchronization [req-5f904613-019a-445b-9376-22357346ed63 req-5ffef664-9ef4-45ba-802a-d78506741cbd tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_members [ 1397.038176] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_members [ 1397.038476] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb52c5b-5242-481b-b676-5b24fc2c97d8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.038600] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.038668] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.038863] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.039185] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.039294] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.039346] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.039498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.039584] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.039720] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.295024] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock network-854 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.295024] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.295024] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.295024] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.295331] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.295331] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.295422] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.295591] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.295736] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.296067] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1397.296178] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] NeedRegenerationException {{(pid=65359) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1397.296333] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] no value, waiting for create lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1397.296449] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] value creation lock acquired {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1397.296555] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] No value present for key: 'zone-id' {{(pid=65359) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1397.296662] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Calling creation function for not-yet-present value {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1397.296794] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1397.315813] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1397.315978] env[65359]: DEBUG dogpile.cache.region [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65359) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1397.316132] env[65359]: DEBUG dogpile.lock [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Released creation lock {{(pid=65359) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1397.316331] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "network-854" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.316630] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock port-98cb40f6-ceb6-4a80-b3a4-c58645921b26 taken with stack trace [, , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.316803] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "port-98cb40f6-ceb6-4a80-b3a4-c58645921b26" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.316902] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "port-98cb40f6-ceb6-4a80-b3a4-c58645921b26" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.317228] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "port-98cb40f6-ceb6-4a80-b3a4-c58645921b26" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.317442] env[65359]: DEBUG networking_nsxv3.api.rpc [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98cb40f6-ceb6-4a80-b3a4-c58645921b26',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.541782] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.820350] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.820668] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.820768] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.821040] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.821197] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.821374] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Segment Port 98cb40f6-ceb6-4a80-b3a4-c58645921b26 not found, creating... [ 1397.821639] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.821797] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.821913] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.822139] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.822306] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.822569] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.822757] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.822885] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.823125] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.823271] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.823424] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Resource: SegmentPort with ID: 98cb40f6-ceb6-4a80-b3a4-c58645921b26 is going to be created. [ 1397.844058] env[65359]: DEBUG networking_nsxv3.common.locking [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.844328] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.844478] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.844724] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.844946] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.845176] env[65359]: DEBUG oslo_concurrency.lockutils [None req-d50d5f73-54bb-45aa-9346-f08ad0ce4730 None None] Releasing lock "port-98cb40f6-ceb6-4a80-b3a4-c58645921b26" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.044387] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.523767] env[65359]: INFO networking_nsxv3.common.synchronization [req-5f904613-019a-445b-9376-22357346ed63 req-e5fbabde-b8fa-4480-9156-1273f0d503da service nova] Enqueued Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_rules [ 1398.523951] env[65359]: INFO networking_nsxv3.common.synchronization [req-5f904613-019a-445b-9376-22357346ed63 req-e5fbabde-b8fa-4480-9156-1273f0d503da service nova] Enqueued Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_members [ 1398.524102] env[65359]: INFO networking_nsxv3.common.synchronization [req-5f904613-019a-445b-9376-22357346ed63 req-e5fbabde-b8fa-4480-9156-1273f0d503da service nova] Enqueued Resource ID: 98cb40f6-ceb6-4a80-b3a4-c58645921b26 with Priority: HIGHEST for action port [ 1398.524608] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_rules [ 1398.524748] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_members [ 1398.524844] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98cb40f6-ceb6-4a80-b3a4-c58645921b26 with Priority: HIGHEST for action port [ 1398.525650] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.525786] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.525856] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.526077] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.526159] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.527497] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb52c5b-5242-481b-b676-5b24fc2c97d8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.527602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.527916] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock port-98cb40f6-ceb6-4a80-b3a4-c58645921b26 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.528033] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98cb40f6-ceb6-4a80-b3a4-c58645921b26" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.528098] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98cb40f6-ceb6-4a80-b3a4-c58645921b26" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.528302] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98cb40f6-ceb6-4a80-b3a4-c58645921b26" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.528382] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98cb40f6-ceb6-4a80-b3a4-c58645921b26',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.546501] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.546673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.546673] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.546847] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.546945] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.547057] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 is going to be updated. [ 1398.577040] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.577290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.577290] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.577472] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.577617] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.589561] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: IN_PROGRESS for 2s [ 1399.028352] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb52c5b-5242-481b-b676-5b24fc2c97d8 taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.028565] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.030864] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98cb40f6-ceb6-4a80-b3a4-c58645921b26 with status ACTIVE [ 1399.031116] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.031270] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.031383] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.031602] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.031693] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.031872] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.031971] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.032050] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.032209] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.032288] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.032470] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.032564] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.032625] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.032764] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.032837] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.032918] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98cb40f6-ceb6-4a80-b3a4-c58645921b26 is going to be updated. [ 1399.055751] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.056153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.056153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.056153] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.056319] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.056444] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98cb40f6-ceb6-4a80-b3a4-c58645921b26" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.600182] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: SUCCESS [ 1400.600581] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.600964] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.601200] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.601413] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.601498] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.601563] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.601713] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.601793] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.601890] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.104259] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.606204] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.108730] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.109000] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.109000] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.109233] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.109340] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.109424] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 is going to be updated. [ 1402.143667] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.143978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.143978] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.144312] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.144492] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.155624] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: IN_PROGRESS for 2s [ 1403.526049] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.526533] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1404.168092] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: SUCCESS [ 1404.168355] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.168482] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.168703] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.168894] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.169028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.169091] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.169251] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.169342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.169443] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.169546] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.671473] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.174849] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cfb52c5b-5242-481b-b676-5b24fc2c97d8: rpc.has_security_group_logging(os_id): False [ 1405.192892] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.193108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.193108] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.193342] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.193471] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.193656] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.193756] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.193817] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.193967] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.194094] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.194192] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 is going to be updated. [ 1405.253620] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.253876] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.253876] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.254043] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.254214] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.266956] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: IN_PROGRESS for 2s [ 1407.282155] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: SUCCESS [ 1407.282589] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.527494] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.527917] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.529395] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.529809] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.531208] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.531610] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.532307] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.532633] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.533405] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.533860] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.534920] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.535412] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.536694] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.537130] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.538084] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.538463] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.539914] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.540359] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.540814] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.541274] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.542593] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.543023] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1463.543758] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1463.543758] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.195316] env[65359]: INFO networking_nsxv3.common.synchronization [req-f2e1dd10-cd56-46a3-896a-7ad9cb51d17e req-2d628004-698e-4d0c-aba0-625d38a58d3d tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_members [ 1466.195818] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_members [ 1466.196141] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb52c5b-5242-481b-b676-5b24fc2c97d8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.196472] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.196472] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.197160] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.197372] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.197481] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.197572] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.197768] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.197865] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.197964] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.700077] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.203068] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.705286] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.705657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.705657] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.705792] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.705871] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.705983] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 is going to be updated. [ 1467.750455] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.750669] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.750669] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.750818] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.750957] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.759747] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: IN_PROGRESS for 2s [ 1469.771216] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: SUCCESS [ 1469.771682] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.196960] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.197369] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.197619] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.197619] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.198965] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.199403] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.490265] env[65359]: INFO networking_nsxv3.common.synchronization [req-fefac7e9-3cd1-4d09-87a3-5ebe4cd80ce3 req-e424e094-b010-4985-a734-33b404535073 tempest-ServerActionsTestOtherA-1149909587 tempest-ServerActionsTestOtherA-1149909587-project-member] Enqueued Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_members [ 1482.490801] env[65359]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 with Priority: HIGHEST for action security_group_members [ 1482.491117] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb52c5b-5242-481b-b676-5b24fc2c97d8 taken with stack trace [, , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.491245] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.491311] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.491503] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.491651] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.491748] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.491812] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.491951] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.492168] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.492278] env[65359]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfb52c5b-5242-481b-b676-5b24fc2c97d8',) {} {{(pid=65359) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1482.995084] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.995312] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.995312] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.995547] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.995649] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.995846] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.995948] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.996028] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.996241] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.996321] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.996411] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 is going to be updated. [ 1483.023891] env[65359]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65359) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.024149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.024149] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.024310] env[65359]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.024449] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.033061] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: IN_PROGRESS for 2s [ 1485.046020] env[65359]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 in Status: SUCCESS [ 1485.046420] env[65359]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfb52c5b-5242-481b-b676-5b24fc2c97d8 deletion is rescheduled due to dependency. [ 1485.046420] env[65359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb52c5b-5242-481b-b676-5b24fc2c97d8" {{(pid=65359) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.492173] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1487.492173] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1492.493253] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1492.493745] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1494.512690] env[65359]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1494.513123] env[65359]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cbc874ee-e26f-4463-ab8a-cfb98da30f13 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1497.494841] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1497.495280] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1502.496300] env[65359]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1502.496736] env[65359]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0